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* NOTICES * 

JPO and NCI PI are not responsible for any 
damages caused by the use of this translation. 

IThis document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] The server equipment which distributes an image and speech information, and the 
client equipment which receives the image and speech information distributed from this server 
equipment, and is reproduced, In the multimedia communication control approach in the system 
which consists of a communication network which connects said server equipment and said 
client equipment said server equipment By being the information which accompanies an image 
and speech information, and using the function of an external device If accompanying information 
including the information about the approach of using the external device for complementing the 
contents of an image and speech information is held for every parts of the image and speech 
information to distribute and a distribution demand of accompanying information is received from 
said client equipment Accompanying information required before playback of an image and 
speech information is distributed to the client equipment, and accompanying information is 
distributed periodically after that. Said client equipment While transmitting the distribution 
demand of an image and speech information to said server equipment As opposed to said server 
equipment A distribution demand of accompanying information It transmits, and required 
accompanying information is received from said server equipment before playback of the 
distributed image and speech information, the accompanying information distributed from said 
server equipment still more nearly periodically is received, and old accompanying information is 
transposed to new accompanying information. The function of an external device The multimedia 
communication control approach characterized by calling an external device based on the 
distributed newest accompanying information in using. 

[Claim 2] The server equipment which distributes an image and speech information, and the 
client equipment which receives the image and speech information distributed from this server 
equipment, and is reproduced, In the multimedia communication control approach in the system 
which consists of a communication network which connects said server equipment and said 
client equipment said server equipment By being the information which accompanies an image 
and speech information, and using the function of an external device If accompanying information 
including the information about the approach of using the external device for complementing the 
contents of an image and speech information is held for every parts of the image and speech 
information to distribute and a distribution demand of accompanying information is received from 
said client equipment Accompanying information corresponding to each part of the image and 
speech information to distribute is continuously performed to the client equipment synchronizing 
with distribution of each part of an image and speech information. Said client equipment While 
transmitting the distribution demand of an image and speech information to said server 
equipment As opposed to said server equipment A distribution demand of accompanying 
information Transmit and each part of the distributed image and speech information In receiving 
the accompanying information corresponding to [ both ] each of that part which receives 
continuously and is reproduced before playback of the image and speech information of each of 
that part and using the function of an external device The multimedia communication control 
approach characterized by calling an external device based on the accompanying information 
corresponding to the parts of the image and speech information under playback 
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[Claim 3] The server equipment which distributes an image and speech information, and the 
client equipment which receives the image and speech information distributed from this server 
equipment, and is reproduced, In the multimedia communication control approach in the system 
which consists of a communication network which connects said server equipment and said 
client equipment said server equipment By being the information which accompanies an image 
and speech information, and using the function of an external device The contents of an image 
and speech information If the distribution demand of accompanying information which held 
accompanying information including the information about the approach of using the external 
device for complementing, for every parts of the image and speech information to distribute, and 
specified an image and voice playback positional information from said client equipment is 
received It distributes to the client equipment of accompanying information corresponding to Its 
image and voice playback positional information demand-origin to the client equipment. Said 
client equipment In order to transmit the distribution demand of an image and speech information 
to said server equipment, to reproduce the image and speech information distributed by that 
cause and to use the function of an external device during playback of an image and speech 
information, when accompanying information is needed The multimedia communication control 
approach characterized by transmitting a distribution demand of the accompanying information 
accompanied by the image and voice playback positional information at the time to said server 
equipment, receiving accompanying information from said server equipment, and calling an 
external device based on the received accompanying information. 

[Claim 4] The server equipment which distributes an image and speech information, and the 
client equipment which receives the image and speech information distributed from this server 
equipment, and is reproduced. In the multimedia communication control approach in the system 
which consists of a communication network which connects said server equipment and said 
client equipment said server equipment By being the information which accompanies an image 
and speech information, and using the function of an external device If accompanying information 
including the information about the approach of using the external device for complementing the 
contents of an image and speech information is held for every parts of the image and speech 
information to distribute and a distribution demand of accompanying information is received from 
said client equipment As opposed to the client equipment Distribute accompanying information 
required before playback of an Image and speech information, supervise whether modification 
was added to accompanying information after that, when modification of accompanying 
information is detected, distribute the accompanying information which modification produced to 
said client equipment, and said client equipment receives said server equipment. While 
transmitting the distribution demand of an image and speech information, said server equipment 
Is received. When the accompanying information which transmitted the distribution demand of 
accompanying information, and received required accompanying information from said server 
equipment, and modification produced before playback of the distributed image and speech 
information is distributed from said server equipment being alike — the multimedia 
communication control approach characterized by calling an external device based on the 
newest accompanying information distributed when old accompanying information was 
transposed to new accompanying information and the function of an external device was used. 
[Claim 5] The server equipment which distributes an image and speech information, and the 
client equipment which receives the Image and speech information distributed from this server 
equipment, and is reproduced, In the multimedia communication control system which consists of 
a communication network which connects said server equipment and said client equipment said 
server equipment By being the Information which accompanies an image and speech information, 
and using the function of an external device A means to hold accompanying information including 
the information about the approach of using the external device for complementing the contents 
of an image and speech information, for every parts of the image and speech information to 
distribute. In response to the distribution demand of an Image and speech information, an Image 
and speech information are put in block from said client equipment. Or a means to continue and 
distribute for every part and a means to receive a distribution demand of accompanying 
information from said client equipment. The newest accompanying information which is needed at 
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least before playback of the image and speech information in said client equipment or playback 
of each of that part is distributed to a distribution demand of the accompanying information from 
said client equipment, the image and voice playback positional information from said client 
equipment It has a means to distribute the accompanying Information corresponding to its Image 
and voice playback positional information, to a distribution demand of the specified 
accompanying information. Said client equipment A means to transmit the distribution demand of 
an image and speech Information to said server equipment, and to reproduce the distributed 
image and speech information, When accompanying information is needed while reproducing the 
image and speech information which transmits a distribution demand of accompanying 
information or was distributed to said server equipment before playback of the distributed Image 
and speech information, or playback of each of that part A means to transmit a distribution 
demand of the accompanying information accompanied by an image and voice playback positional 
information to said server equipment, The multimedia communication control system 
characterized by having an external device control means to call an external device based on the 
newest accompanying information distributed from said server equipment when using the 
function"l>f ah~ external~devicer 

[Claim 6] An image and speech information are gone via a communication network. By being the 
record medium which recorded the program which the server equipment in the multimedia 
communication control system distributed to client equipment performs, being the information 
which accompanies the image and speech information accumulated for every parts of the image 
and speech information to distribute, and using the function of an external device The processing 
which manages accompanying information including the information about the approach of using 
the external device for complementing the contents of an image and speech information, and is 
read to the distribution demand of the accompanying information from said client equipment. In 
response to the distribution demand of an image and speech information, an image and speech 
information are put in block from said client equipment. Or processing continued and distributed 
for every part and processing which receives a distribution demand of accompanying information 
from said client equipment. The newest accompanying information which is needed at least 
before playback of the image and speech information in said client equipment or playback of 
each of that part is distributed to a distribution demand of the accompanying information from 
said client equipment, the Image and voice playback positional Information from said client 
equipment The record medium which recorded the program of the server equipment in the 
multimedia communication control system characterized by the thing which is made for a 
calculating machine to perform processing which distributes the accompanying information 
corresponding to its image and voice playback positional information to a distribution demand of 
the specified accompanying information, and which carried out program documentation. 
[Claim 7] It goes via a communication network from the server equipment which distributes an 
image and speech information. Are the record medium which recorded the program which the 
client equipment in the multimedia communication control system which receives the distributed 
image and speech information, and is reproduced performs, and said server equipment is 
received. The processing which transmits the distribution demand of an Image and speech 
information, and reproduces the distributed image and speech information. By said server 
equipment's being the information which accompanies the image and speech information held for 
every parts of an image and speech information, and using the function of an external device 
before playback of the distributed image and speech information, or playback of each of that part 
When accompanying information is needed while transmitting the distribution demand about 
accompanying information Including the information about the approach of using the external 
device for complementing the contents of an Image and speech information, to said server 
equipment or reproducing the distributed image and speech information The processing which is 
alike and transmits a distribution demand of the accompanying information accompanied by an 
image and voice playback positional information to said server equipment. The function of an 
external device The record medium which recorded the program of the client equipment in the 
multimedia communication control system characterized by the thing which is made for a 
calculating machine to perform processing which calls an external device based on the newest 
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accompanying information distributed from said server equipment when using, and which carried 
out program documentation. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
10001] - - 

[Field of the Invention] This invention relates to the multimedia communication control approach 
of performing distribution of an image and speech information, and playback, and its system, on a 
communication network. 
[0002] 

[Description of the Prior Art] It sets on the technique treat distribution or playback of an image 
and speech information on current and a network, and the method of specifying the usage of 
change of a setup of support, and other programs and the function of equipment accompanying 
the time amount progress from a setup of the support of the link between two or more image 
and voice and playback initiation of an image and voice exists to distribution, and the image and 
the voice to reproduce. 

[0003] The control approach by the programming language represented by JavaScript which 
controls two or more image and voice in the approach represented by SMIL of the WWW 
consortium (W3C) specification which controls two or more image and voice in an image and a 
voice distribution playback technique as the approach on a network, and HTML displayed by the 
WWW browser, and CGI (Common Gateway Interface) exists. 

[0004] When the art in informational (it is henceforth called accompanying information) the are- 
recording approaches and the distribution approaches which accompany an image and speech 
information, such as the setting approach of a hyperlink, the usage of other equipments, etc. for 
distribution, and the image and the voice which are reproduced, is shown, in the above- 
mentioned approach, there is no difference in distribution, and the art of the assignment 
information on an image and voice and the art of accompanying information reproduce. 
[0005] For example, by SMIL, the assignment information and accompanying information on an 
image and voice which are distributed and reproduced are described by the same location. 
Moreover, the assignment information and accompanying information on an image and voice 
which a program refers to and which are distributed and reproduced as a database are described 
by JavaScript and CGI in the program same as the same information. 
[0006] 

[Problem(s) to be Solved by the Invention] As mentioned above, in the playback approach of an 
image and speech information, and the method of treating accompanying information, during 
playback of an image or voice, when especially broadcasting live junction and a radio 
broadcasting on a network, support information on a link was not able to be changed in client 
equipment 

[0007] If an example is given, in SMIL, client equipment will acquire the information about all 
accompanying information from server equipment at the time of playback initiation of an image. 
Therefore, when accompanying information was changed after playback initiation, accompanying 
information was not already able to be acquired from server equipment, and the contents of 
modification were not able to be notified to the client equipment which is reproducing an image 
and voice. 

[0008] In JavaScript, since the WWW browser acquired the contents of all accompanying 
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information at the time of acquisition of the information on HTML, the contents of modification 
of accompanying information were not able to be notified to client equipment for the same 
reason. 

[0009] Moreover, although it was possible to have notified modification of accompanying 
information to client equipment by specifying a CGI program as the display contents of a WWW 
browser as a link place when using CGI, the synchronization with the timing which sends 
modification of accompanying information from server equipment, and the timing to which client 
equipment reproduces an image and voice was not taken. 

[0010] This invention solves the problem produced when an image and speech information were 
distributed on a communication network using a Prior art that where of modification of 
accompanying information cannot be performed during playback of an image and voice, 
modification of accompanying information notifies to client equipment during playback of an 
image and voice, and it aims at making it possible to take a synchronization to playback of an 
image and voice, and modification of accompanying information. 
[0011] 

[Means for Solving the Problem] In order to attain the above purpose, this invention distributes 
an image and speech information from server equipment to client equipment on a comnriunication 
network, performs distribution and reception of accompanying information apart from an image 
and speech information in the reproduced image and the voice distribution approach, and is 
characterized by enabling it to notify distribution of accompanying information, and modification 
between server equipment and client equipment during playback of an image or voice. 
[0012] The means which has each following function in order to enable it to make distribution 
and modification of accompanying information between server equipment and client equipment 
during playback of an image or voice as mentioned above is formed in server equipment and 
client equipment. 

[0013] An accompanying information storage means to hold and accumulate accompanying 
information including the information about the approach of complementing the contents of an 
image and speech information by accompanying an image and speech information and using the 
function of an external device for server equipment for every parts of an image and voice. An 
accompanying information distribution demand receiving means to receive the accompanying 
information distribution demand from client equipment, an accompanying information distribution 
means to distribute accompanying information, and management of the accumulated 
accompanying information and the accompanying information distribution control means which 
manages distribution of accompanying information are prepared. 

[0014] Moreover, an accompanying information distribution demand transmitting means to require 
distribution of accompanying information of client equipment at server equipment based on a 
demand of a user. The image and a voice playback location extract means to gain the playback 
location of an image and voice when a distribution demand of accompanying information is 
transmitted, An accompanying information receiving means to receive the accompanying 
information distributed from server equipment. The accompanying information control means 
which takes the synchronization with the playback location of an image and voice where the 
received accompanying information is decoded and accompanying information corresponds, and 
the playback image and voice location which are actually reproduced. The accompanying 
information actuation means for choosing the external device used from an accompanying 
information-display means to display the received accompanying information, and the input and 
accompanying information-display means of a distribution demand from the user of 
accompanying information. An external device control means to start an external device based 
on the input fi'om an accompanying information actuation means is established. 
[0015] The operation of this invention is as follows. In the accompanying information distribution 
demand transmitting means of client equipment, and the accompanying information distribution 
demand receiving means of server equipment, in server equipment and client equipment with an 
above-mentioned means, the distribution demand of an image and speech information has 
transmitted the distribution demand of accompanying information independently to server 
equipment from client equipment. In server equipment, an accompanying information storage 
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means, an accompanying information distribution control means, and an accompanying 
information distribution means are performing message distribution processing of accompanying 
information, and are distributing accompanying information independently with the message 
distribution processing of an image and speech information. 

[0016] On the other hand, in client equipment, it is establishing an accompanying information 
receiving means and an accompanying information control means, and is the reception of an 
image and speech information performing reception of accompanying information independently, 
and establishing an accompanying information-display means, an accompanying information 
actuation means, and an external device control means, and playback of an image and voice is 
using the external device independently. 

[0017] Therefore, it becomes possible [ distribution of an image and speech information, or 
reproductive processing ] independently to perform distribution or reception of accompanying 
information, and server equipment and client equipment enable to notify modification of 
accompanying information to client equipment during distribution of an image and speech 
information, or playback, and it becomes possible at this invention to take playback of an image 
and voice^and~the~synchronizati'o~n of modification^ information in client 

equipment. 

[0018] A program for a computer to realize each processing means of the server equipment of a 
more than and client equipment is storable in suitable record media, such as portable medium 
memory which a computer can read, semiconductor memory, and a hard disk. 
[0019] 

[Embodiment of the Invention] Hereafter, the gestalt of operation of this invention is explained 
using drawing. Drawing 1 is drawing showing the example of a configuration of the server 
equipment concerning this invention, and drawing 2 is drawing showing the example of a 
configuration of the client equipment concerning this invention. Server equipment 10 and client 
equipment 20 are connected via a communication network 100. Generally, two or more client 
equipments 20 are connected to the communication network 100. 

[0020] The image and a speech information are recording means 101 by which server equipment 
10 accumulates an image and speech information as shown in drawing 1 , The image and the 
speech information distribution control means 1 02 which controls distribution of an image and 
speech information. The image and a speech information distribution demand receiving means 
103 to receive the image and speech information distribution demand from client equipment 20, 
The image and a speech information distribution means 104 to distribute the accumulated image 
and speech information. By accompanying an image and speech information and using the 
function of an external device 30 (not shown) An accompanying information storage means 111 
to accumulate and hold accompanying information including the information about the approach 
of using the external device 30 for complementing the contents of an image and speech 
information, for every parts of an image and speech information. It has management of the 
accumulated accompanying information, the accompanying information distribution control means 
1 1 2 which manages distribution of accompanying information, an accompanying information 
distribution demand receiving means 1 1 3 to receive the accompanying information distribution 
demand from client equipment 20. and the accompanying information distribution means 114 for 
distributing accompanying information. The image and speech information input means from a 
camera etc. other than the image and speech information are recording means 101 instead of 
above-mentioned image and speech information are recording means 101 can also be used. 
[0021] Although not necessarily limited to that it is not necessarily explained below that uses 
the function of an external device 30 here, it is using the Internet telephone of the specific 
message place related to the part under the playback, or accessing a specific homepage by the 
WWW browser, or accessing a specific FTP (File Transfer Protocol) server, and transmitting or 
gaining a certain file, for example during playback of a certain image and voice. 
[0022] As shown in drawin g 2 , client equipment 20 The playback image and a voice output 
means 201 to output the reproduced image and voice. The image and a speech information 
actuation means 202 to operate the distributed image and speech information. The playback 
control means 203 which controls playback of the distributed image and speech information. The 
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image and a speech information distribution demand transmitting means 204 to transmit an image 
and a speech information distribution demand to server equipment 10, The image and a speech 
information receiving means 205 to receive the distributed image and speech information, The 
image and a voice playback location extract means 206 to gain an image and a voice playback 
location when a user gives an acquisition demand of accompanying information during an image 
and voice playback, An accompanying information actuation means 21 1 to choose the external 
device 30 which inputs a distribution demand of the accompanying information from a user, and 
is used from the accompanying information-display means 212, The received accompanying 
information The accompanying information control means 213 which takes the synchronization 
with an accompanying information-display means 212 to display, and the image and voice 
playback location where the received accompanying information is decoded and accompanying 
information corresponds, and the image and voice playback location which the playback control 
means 203 is actually reproducing, An accompanying information distribution demand 

-transmitting means 214 to require distribution of accompanying information of server equipment 
10 based on a demand of a user. It has an accompanying information receiving means 215 to 

"receive the accompanying informatidnf distributed from'server equipment 10, and an external 
device control means 216 to start an external device 30 based on the input from the 
accompanying information actuation means 211. 

[0023] For example, as accompanying information which accompanies the parts of the image and 
speech information under playback, it is (a). When using an Internet telephone for an external 
device ****** point information and (b) The connection place information when using a WWW 
browser for an external device, and (c) When connection place information , when using a FTP 
server for an external device is set up. When the accompanying information actuation means 21 1 
inputs a use demand of accompanying information from a user, the accompanying information- 
display means 212 By the notice from the accompanying information actuation means 21 1, it is 
based on the accompanying information at that time, and is (a) as an available external device. 
An Internet telephone and (b) A WWW browser and (c) It indicates that there is a FTP server. If 
a user chooses an external device with the accompanying information actuation means 21 1, to 
the external device control means 216, the accompanying information at that time and a user's 
selection information will be notified, and the external device control means 216 will call the 
external device 30 which the user chose based on the notified accompanying information. 
[0024] As a means about distribution of the image and speech information in server equipment 
10 and client equipment 20, mounting offer example, the following (1) - (3) is possible. 
[0025] (1) The image and the speech information distribution demand transmitting means 204 of 
client equipment 20 transmit an image and a speech information distribution demand to server 
equipment 10. The image and the speech information distribution means 104 of server equipment 
10 distribute all the information on an image and speech information to client equipment 20, 
before the playback control means 203 of client equipment 20 starts playback of an image and 
voice. 

[0026] (2) The image and the speech information distribution demand transmitting means 204 of 
client equipment 20 transmit an image and a speech information distribution demand to server 
equipment 10. When server equipment 10 starts distribution of an image and speech information, 
the playback control means 203 starts playback of an image and voice at the same time client 
equipment 20 receives a part of image and speech information. 

[0027] (3) The image and the speech information distribution demand transmitting means 204 of 
client equipment 20 transmit an image and a speech information distribution demand to server 
equipment 10. The image and the speech information distribution means 104 of server equipment 
10 distribute the image and speech information of these contents to coincidence to the unit or 
two or more client equipments 20 which gave the image and the speech information distribution 
demand to server equipment 10. 

[0028] Moreover, mounting of for example, the following (1) - (5) is possible as a means about 
distribution of the accompanying information in server equipment 10 and client equipment 20. 
[0029] (1) The accompanying information distribution demand transmitting means 214 of client 
equipment 20 transmits a distribution demand of accompanying information to server equipment 
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10 at the time of playback initiation of an image and speech information. The accompanying 
information distribution control means 112 of server equipment 10 and the accompanying 
information distribution means 114 will distribute required accompanying information to client 
equipment 20 before playback initiation of the image and voice of client equipment 20, if an 
accompanying information distribution demand is received. 

[0030] (2) The accompanying information distribution control means 1 1 2 of server equipment 1 0 
and the accompanying information distribution means 114 continue distributing accompanying 
information at fixed spacing. Moreover, the accompanying information control means 213 of 
client equipment 20 compares the accompanying information distributed at fixed spacing with the 
accompanying information acquired at the time of transmission of an image voice delivery 
information demand, and when these differ, it changes accompanying information. 
[0031] (3) The accompanying information distribution demand transmitting means 214 of client 
equipment 20 advances a distribution demand of accompanying information to server equipment 

_1.0,at the time of playback initiation of an image and speech information. If a distribution demand 
of accompanying information is received, the accompanying information distribution control 

"means" 1 1 2 of server equipment 10 and~the"accompanying-information-distribution means 114 will 
synchronize, will perform distribution of an image and speech information, and distribution of 
accompanying information, and will distribute the accompanying information, corresponding to 
each part of an image to client equipment 20. 

[0032] (4) The image and the voice playback location extract means 206 of client equipment 20 
acquire an image and voice playback positional information, when a user gives an acquisition 
demand of accompanying information during playback of an image and speech information. 
Moreover, the accompanying information distribution demand transmitting means 214 transmits a 
distribution demand of the accompanying information accompanied by the acquired image and 
voice playback positional information to server equipment 10. The accompanying information 
distribution means 114 of server equipment 10 will distribute the accompanying information 
corresponding to the received image and voice playback location, if this distribution demand is 
received. 

[0033] (5) When modification arises to accompanying information, the accompanying information 
distribution control means 1 12 of server equipment 10 recognizes that modification arose, and 
directs distribution of the accompanying information which the modification produced for the 
accompanying information distribution means 114. The accompanying information distribution 
means 114 distributes the accompanying information which modification produced to client 
equipment 20, when the notice of modification of accompanying information is received from the 
accompanying information distribution control means 112. 

[0034] By each of these means, this invention has the accompanying information distribution 
function that the server equipment 10 which an image and speech information distributed, and 
client equipment 20 transmitted an accompanying information distribution demand to server 
equipment 10 in addition to the image and the voice distribution regenerative function to which 
client equipment 20 reproduces an image and voice, and received a distribution demand 
distributes accompanying information, and the external device starting function that client 
equipment 20 calls an external device 30 based on accompanying information, in server 
equipment 10. Below, the flow of the processing in the gestalt of each operation is explained. 
[0035] [Gestalt of the 1 st operation] Drawing 3 is drawing for explaining the flow of the 
processing in the gestalt of the 1 st operation. The flow of the processing shown in drawing 3 
between server equipment 10 and client equipment 20 When an image and a speech information 
distribution demand are transmitted from client equipment 20 to server equipment 10 Client 
equipment 20 playback of an image and voice Before starting, when all the information on image 
information and accompanying information is distributed to client equipment 20 from server 
equipment 1 0. and accompanying information is periodically distributed to client equipment 20 
from sender equipment 10 and modification arises to accompanying information, modification of 
accompanying information In the approach of performing, it is a thing when using accompanying 
information. 

[0036] If an image and a speech information distribution demand signal, and an accompanying 
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information distribution demand signal are transmitted to server equipment 10 from the image 
and the speech information distribution demand transmitting means 204 of client equipment 20, 
the image and the speech information distribution demand receiving means 1 03 of server 
equipment 10, and the accompanying information distribution demand receiving means 113 will 
receive each signal (SI 01. SI 02). Server equipment 10 will distribute all the demanded required 
information on an image and speech information to client equipment 20 from an image and the 
speech information distribution means 1 04, if an image and a speech information distribution 
demand signal are received (SI 03). All the information on the accompanying information which 
accompanies the image and speech information to distribute is also then distributed to client 
equipment 20 from the accompanying information distribution means 114 at coincidence (SI 04). . 
[0037] With client equipment 20, an image and the speech information receiving means 205, and 
the accompanying information receiving means 215 receive all images and speech information, 
and all accompanying information, respectively, and playback of an image and voice is started 
J[S1 05).JHowever, when the demanded image and. speech information, or accompanying 
information is not distributed, client equipment 20 transmits a resending demand of an image and 
speech information, and accompanying information to server equipment 1 0 from an image and 
the speech information distribution demand transmitting means 204, and the accompanying 
information distribution demand transmitting means 214. respectively, and requires distribution of 
an image and speech information, or accompanying information from server equipment 10 again. 
[0038] Server equipment 10 distributes accompanying information to client equipment 20 from 
the accompanying information distribution means 1 14 at fixed spacing. The accompanying 
information control means 213 of client equipment 20 performs the comparison with the 
accompanying information which acquired to the image and the speech-information distribution 
demand whenever the accompanying information receiving means 215 received accompanying 
information, and the accompanying information which newly received, and when the 
accompanying information which acquired to an image and the speech-information distribution 
demand differs from the accompanying information which newly received, the accompanying 
information hold replaces to the accompanying information newly received (SI 06). 
[0039] A user inputs the use demand of the function of an external device 30 into client 
equipment 20 from the accompanying information actuation means 211, when checking a 
playback image and voice and using the function of an external device 30 (SI 07). If the use 
demand of the function of an external device 30 is inputted, the playback control means 203 will 
suspend playback of an image and voice, and will pass playback halt positional information to an 
image and the voice playback location extract means 206 (SIOS^ SI 09). Playback halt positional 
information is also passed at coincidence to the accompanying information control means 213. 
[0040] If playback halt positional information is received, the accompanying information control 
means 213 will be referring to playback halt positional information with reference to the 
accompanying information received from server equipment 10. and it will opt for the action (it is 
henceforth called external information starting conditions) which should perform an external 
device 30 (SI 10). 

[0041] If external information starting conditions are determined, the accompanying information 
control means 213 will pass external information starting conditions to the external device 
control means 216. The external device control means 216 will start an external device 30 based 
on external information starting conditions, if external information starting conditions are 
received. 

[0042] for example, if elapsed time sets to Lt (0<Lt<L1) when recognizing each part of an image 
and voice by the elapsed time from playback initiation, if accompanying information as shown in 
drawing 4 is taken for an example, it will judge from the specific information of Location — 
information[0] 401 become effective. When the user has chosen the WWW browser as an 
external device 30 at this time, a WWW browser opens URL of http://www.*++JMuMuMt according 
to the parameter of ''Browser[0] =http://www.****:MoM6*'' currently written to information [0] 
401 of accompanying information (S1 11). 

[0043] If external information starting conditions are determined, the accompanying information 
control means 21 3 will pass external information starting conditions to the external device 



http:/ /www4.ipdl.ncipi.go.jp/ cgi-bin/tran_web_cgi_ejye 



2006/04/21 



JP.2000-244889,A [DETAILED DESCRIPTION] 



7/1 1 



control means 216. If external information starting conditions are received, the external device 
control means 216 will start an external device 30 based on external information starting 
conditions (S1 12). 

[0044] If a user suspends use of an external device 30. the external device control means 216 
will detect the terminate signal of an external device 30 (S1 13). The external device control 
means 216 will advance the resumption demand of playback to the playback control means 203. 
if the terminate signal of an external device 30 is detected. If the resumption demand of playback 
is received, the playback control means 203 will acquire playback halt positional information from 
an image and the voice playback location extract means 206, and will resume playback from a 
playback halt location (S1 14). 

[0045] As mentioned above, with the gestalt of this operation, client equipment 20 receives 
accompanying information periodically. Thereby, when modification arises to accompanying 
information, client equipment 20 acquires the changed accompanying information from server 
equipment 10. and the synchronization with_playback of the image and voice in client equipment 
20 and the changed accompanying information of it is attained, 

[0046] [Gestalt of the 2nd operation] Drawing"5" is~drawing for explaining the flow of the 
processing in the gestalt of the 2nd operation. The flow of the processing shown in drawing 5 is a 
thing when using accompanying information, when an image and a speech information distribution 
demand are transmitted from client equipment 20 to server equipment 10 between server 
equipment 10 and client equipment 20. and starting playback of an image and voice at the same 
time client equipment 20 receives the image information and the accompanying information 
distributed from server equipment 10. 

[0047] If an image and a speech information distribution demand signal, and an accompanying 
information distribution demand signal are transmitted to server equipment 10 from the image 
and the speech information distribution demand transmitting means 204 of client equipment 20, 
the image and the speech information distribution demand receiving means 103 of server 
equipment 10, and the accompanying information distribution demand receiving means 113 will 
receive these signals, respectively (S201, S202). Server equipment 10 will distribute continuously 
the demanded image and speech information to client equipment 20 from an image and the 
speech information distribution means 104. if an image and a speech information distribution 
demand signal are received (S203). The accompanying information which accompanies the image 
and speech information to distribute is also then distributed to client equipment 20 continuously 
from the accompanying information distribution means 114 at coincidence (S204). 
[0048] Client equipment 20 will start playback of an image and voice to reception and 
coincidence, if an image and the speech information receiving means 205. and the accompanying 
information receiving means 215 receive an image and speech information, and accompanying 
information, respectively (S205). However, when the existence of loss of the information sent on 
a communication network 100 is checked and informational loss is accepted, client equipment 20 
transmits a resending demand of the information lost to server equipment 10 about each of an 
image and speech information, or accompanying information from an image and the speech 
information distribution demand transmitting means 204, and the accompanying information 
distribution demand transmitting means 214. 

[0049] Moreover, before reproducing an image and voice, it is necessary to do the activity which 
takes the synchronization with the image and speech information, and accompanying information 
which were distributed. Therefore, an image, speech information, and accompanying information 
need to be beforehand acquired, in case an image and voice are reproduced, and acquis'rtion of 
an image, speech information, and accompanying information is performed in advance of playback 
of an image and voice. For example, if the time amount for 3 seconds is required for the 
synchronization of processing of a resending demand of information, an image and speech 
information, and accompanying information, as for client equipment 20, the image and speech 
information for 3 seconds, and accompanying information will be acquired before playback of an 
image and voice at least. 

[0050] A user inputs the use demand of the function of an external device 30 into client 
equipment 20 from the accompanying information actuation means 211, when checking a 
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playback image and voice and using the function of an external device 30 (S206). If the use 
demand of the function of an external device 30 is inputted, the playback control means 203 will 
pass the playback positional information at the time of the use demand of the function of an 
external device 30 being inputted to the accompanying information control means 21 3 (S207, 
S208). 

[0051] If playback positional information is received, with reference to the accompanying 
information received from server equipment 10, the accompanying information control means 213 
will be referring to playback positional information, and will determine external information 
starting conditions (S209). 

[0052] If elapsed time sets to Lt (0<Lt<L1) when recognizing each part of an Image and voice by 
the elapsed time from playback initiation, if the accompanying information shown in drawing 4 is 
taken for an example, information[0] 401 will become effective. When the user has chosen the 
WWW browser as an external device 30 at this time, a WWW browser opens URL of 
http://www.'MoMc*jMc3Mc according to the parameter of ''Browser[0] =http://www.*********'' 
currently written to information[0] 401 of accompanying information (S210). 
[0053]-If external information-starting conditions are determinedrthe accompanying information 
control means 213 will pass external information starting conditions to the external device 
control means 216. If external information starting conditions are received, the external device 
control means 216 will start an external device 30 based on external information starting 
conditions (S211). 

[0054] A user s halt of use of an external device 30 checks that the external device control 
means 216 detected the terminate signal of an external device 30, and the external device 30 
has ended it (S21 2). 

[0055] As mentioned above, with the gestalt of this operation, client equipment 20 receives 
accompanying information continuously. Thereby, when modification arises to accompanying 
information, client equipment 20 acquires the always changed accompanying information from 
server equipment 10, and the synchronization with playback of the image and voice in client 
equipment 20 and the changed accompanying information of it is attained. 
[0056] [Gestalt of the 3rd operation] Drawing 6 is drawing for explaining the flow of the 
processing in the gestalt of the 3rd operation. The flow of the processing shown in drawing 6 
between server equipment 1 0 and client equipment 20 When an image and a speech information 
distribution demand are transmitted from client equipment 20 to server equipment 10 When all 
the information on image information is distributed to client equipment 20 from server equipment 
10 before client equipment 20 started playback of an image and voice, and the use demand of 
the function of an external device 30 is inputted from a user about accompanying information It 
is a thing when using accompanying information in the approach of transmitting a distribution 
demand to chisel server equipment 10. and distributing to client equipment 20. 
[0057] If an image and a speech information distribution demand signal are transmitted to server 
equipment 10 from the image and the speech information distribution demand transmitting means 
204 of client equipment 20. the image and the speech information distribution demand receiving 
means 103 of server equipment 10 will receive an image and a speech information distribution 
demand signal (S301). Server equipment 10 will distribute the demanded information on an image 
and speech information to client equipment 20 from an image and the speech information 
distribution means 1 04. if an image and a speech information distribution demand signal are 
received (S302). 

[0058] If an image and the speech information receiving means 205 receive all images and 
speech information, client equipment 20 will start playback of an image and voice (S303). 
However, when the demanded image and speech information are not distributed, client equipment 
20 transmits a resending demand of an image and speech information, and accompanying 
information to server equipment 10 from an image and the speech information distribution 
demand transmitting means 204. and the accompanying information distribution demand 
transmitting means 214, respectively, and requires distribution of an image and speech 
information, or accompanying information from server equipment 1 0 again. 
[0059] A user inputs the use demand of the function of an external device 30 into client 
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equipment 20 from the accompanying information actuation means 211. when checking a 
playback image and voice and using the function of an external device 30 (S304). If the use 
demand of the function of an external device 30 is inputted, the playback control means 203 will 
pass the image and voice playback positional information at the time of the use demand of the 
function of an external device 30 being inputted to the accompanying information control means 
213(8305. S306). 

[0060] If playback positional information is received, the accompanying information control 
means 213 will transmit a distribution demand of accompanying information from the 
accompanying information distribution demand transmitting means 214 while transmitting an 
image and voice playback positional information to server equipment 10 (S307). If an image and 
voice playback positional information, and an accompanying information distribution demand are 
received with the accompanying information distribution demand receiving means 113, server 
equipment 10 will decide the accompanying information which should be distributed to client 
equipment 20 based on an image and voice playback positional information, and will distribute 
accompanying information from the accompanying information distribution means 114 (S308). 
■^However,- when the demanded~accompanying information-is- not distributedrclient equipment 20 
transmits a resending demand of accompanying Information from the accompanying information 
distribution demand transmitting means 214 to server equipment 10, and requires distribution of 
accompanying information from server equipment 1 0 again. 

[0061] If the accompanying information receiving means 215 receives accompanying information, 
external information starting conditions will be determined based on accompanying information 
(S309). If external device starting conditions are determined, the accompanying information 
control means 213 will pass external information starting conditions to the external device 
control means 21 6. If external information starting conditions are received, the external device 
control means 216 will start an external device 30 based on external information starting 
conditions. 

[0062] If elapsed time sets to Lt (0<Lt<L1) when recognizing each part of an image and voice by 
the elapsed time from playback initiation, if the accompanying information shown in drawing 4 is 
taken for an example, information[0] 401 will become effective. When the user has chosen the 
WWW browser as an external device at this time, a WWW browser opens URL of 
http://www.**3Mc***3M: according to the parameter of "Browser[0] =http://www.*********'' 
currently written to information[0] 401 of accompanying information (S310). 
[0063] If external information starting conditions are determined, the accompanying information 
control means 213 will pass external information starting conditions to the external device 
control means 216. If external information starting conditions are received, the external device 
control means 216 will start an external device 30 based on external information starting 
conditions (S311). 

[0064] A user s halt of use of an external device 30 checks that the external device control 
means 216 detected the terminate signal of an external device 30, and the external device 30 
has ended it (S3 12). 

[0065] As mentioned above, with the gestalt of this operation, although client equipment 20 does 
not hold accompanying information in advance, it acquires accompanying information by requiring 
distribution of accompanying information of server equipment 10 according to the demand from a 
user Consequently, when modification arises to accompanying information, client equipment 20 
acquires the changed accompanying information which server equipment 10 has. and the 
synchronization with playback of the image and voice in client equipment 20 and the changed 
accompanying information of it is attained. 

[0066] [Gestalt of the 4th operation] Drawing 7 is drawing for explaining the flow of the 
processing in the gestalt of the 4th operation. The flow of the processing shown in drawin g 7 
between server equipment 10 and client equipment 20 When an image and a speech information 
distribution demand are transmitted from client equipment 20 to server equipment 10 When 
client equipment 20 started playback of an image and voice, accompanying information acquires 
all required information from server equipment 1 0 before client equipment 20 started playback of 
an image and voice and modification of accompanying information arises at the same time it 



http:/ / www4.ipdl.ncipi.go.jp/cgi-bin/tran_web_cgi_eiie 



2006/04/21 



JP,2000-244889A [DETAILED DESCRIPTION] 



10/11 V 



receives the image information distributed from server equipment 10 When server equipment 10 
distributes ** and its modification information to client equipment 20, it is a thing when using 
accompanying information. 

[0067] If an image and a speech information distribution demand signal, and an accompanying 
information distribution demand signal are transmitted to server equipment 10 from the image 
and the speech information distribution demand transmitting means 204 of client equipment 20. 
the image and the speech Information distribution demand receiving means 103 of server 
equipment 10, and the accompanying information distribution demand receiving means 113 will 
receive, respectively (S401, S402). Server equipment 10 will distribute the demanded image and 
speech information to client equipment 20 from an image and the speech information distribution 
means 104. if an image and a speech information distribution demand signal are received. All the 
information on the accompanying information which accompanies the image and speech 
information to distribute is also then distributed to client equipment 20 from the accompanying 
information distribution means 114 at coincidence (S403. S404). 

[0068] If an image and the speech information receiving means 205 receive an image and speech 
information, client equipment 20 will start playback of an image and voice (S405). However, when 
the existence of loss of the information sent on a communication network 100 is checked and 
informational loss is accepted, client equipment 20 transmits a resending demand of the 
information lost to server equipment 1 0 about each of an image and speech information, and 
accompanying information from an image and the speech information distribution demand 
transmitting means 204. and the accompanying information distribution demand transmitting 
means 214. 

[0069] Moreover, it is necessary to do the activity which takes the synchronization with the 
image and speech information, and accompanying information which were distributed before 
playback of an image and voice. Therefore, in case an image, speech information, and 
accompanying information reproduce an image and voice, they need to be acquired beforehand, 
and acquisition of an image, speech information, and accompanying information is performed in 
advance of playback of an image and voice. For example, if the time amount for 3 seconds is 
required for the synchronization of processing of a resending demand of information, an image 
and speech information, and accompanying information, as for client equipment 20, the image and 
speech information for 3 seconds, and accompanying information will be acquired before 
playback of an image and voice at least. 

[0070] Server equipment 1 0 will distribute the changed accompanying information from the 
accompanying information distribution means 114 to client equipment 20, if modification of the 
accompanying information accumulated in the accompanying information storage means 1 1 1 is 
detected by the accompanying information distribution control means 112. Client equipment 20 
performs the comparison with the accompanying information which acquired to an image and a 
speech-information distribution demand when the accompanying information receiving means 
215 received the changed accompanying information, and the accompanying information which 
newly received, and when the accompanying information which acquired to an image and a 
speech-information distribution demand differs from the accompanying information which newly 
received, it replaces the accompanying information hold to the accompanying information newly 
received (S406). 

[0071] A user inputs the use demand of the function of an external device 30 into client 
equipment 20 from the accompanying information actuation means 21 1. when checking a 
playback image and voice and using the function of an external device (S407). 
[0072] If the use demand of the function of an external device 30 is inputted, the playback 
control means 203 will pass the playback positional information of the image and voice at the 
time of the use demand of the function of an external device 30 being inputted to the 
accompanying information control means 213 (S408, S409). 

[0073] If playback positional information is received, with reference to the accompanying 
information received from server equipment 10, the accompanying information control means 213 
will be referring to playback positional information, and will determine external information 
starting conditions (S410). 
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[0074] If elapsed time sets to Lt (0<Lt<L1) when recognizing each part of an image and voice by 
the elapsed time from playback initiation, if the accompanying information shown in drawing 4 is 
taken for an example, information[0] 401 will become effective. When the user has chosen the 
WWW browser as an external device 30 at this time, a WWW browser opens URL of 
http://www.********* according to the parameter of "Browser[0] =http://www.«=*******'' 
currently written to information[0] 401 of accompanying information (S41 1). 
[0075] If external information starting conditions are determined, the accompanying information 
control means 213 will pass external information starting conditions to the external device 
control means 216. If external information starting conditions are received, the external device 
control means 216 will start an external device 30 based on external information starting 
conditions (S412). 

[0076] A user s halt of use of an external device 30 checks that the external device control 
means 216 detected the terminate signal of an external device 30, and the external device 30 
has ended it (S413). 

[0077] As mentioned above, with the gestalt of this operation, client equipment 20 receives the 
"new accompanying information changed at the time of modification-of accompanying information. 
Thereby, when modification arises to accompanying information, client equipment 20 acquires the 
changed accompanying information from server equipment 10. and the synchronization with 
playback of the image and voice in client equipment 20 and the changed accompanying 
information of it is attained. 

[0078] In addition, in the above explanation, it cannot be overemphasized that both of an image 
and voice are sufficient as either an image or voice. Moreover, although explanation of the 
gestalt of the above-mentioned implementation explained the example which distributes the 
image and speech information accumulated beforehand, in distribution of the image and speech 
information which has time constraint by distribution, for example from an information input like 
play-by-play broadcasting, this invention is applicable similarly. 
[0079] 

[Effect of the Invention] As explained above, when distributing an image and voice on a 
communication network by using this invention, independently of distribution or regeneration of 
an image and speech information, the message distribution processing of accompanying 
information becomes possible. Therefore, during playback of an image and voice, even when 
modification of accompanying information arises, the modification information on accompanying 
information can be distributed from server equipment to client equipment. 
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* NOTICES * 

JPO and NCI PI are not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



TECHNICAL FIELD 



[Field of the Invention] This invention relates to the multimedia communication control approach 
of performing distribution of an image and speech information, and playback, and its system, on a 
comm unication netwo rk. _ 
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* NOTICES * 

JPO and NCI PI are not responsible for' any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



PRIOR ART 



[Description of the Prior Art] It sets on the technique treat distribution or playback of an image 
and speech information on current and a network, and the method of specifying the usage of 
_change_of a setup_of_supp_Qrt,.andjother programs and the function of ,equjpjTient_accompanying 
the time amount progress from a setup of the support of the link between two or more image 
and xpjce and playback initiation of an image and yoice exists to distribution, and the image and 
the voice to reproduce. 

[0003] The control approach by the programming language represented by JavaScript which 
controls two or more image and voice in the approach represented by SMIL of the WWW 
consortium (W3C) specification which controls two or more image and voice in an image and a 
voice distribution playback technique as the approach on a network, and HTML displayed by the 
WWW browser, and CGI (Common Gateway Interface) exists. 

[0004] When the art in informational (it is henceforth called accompanying information) the are- 
recording approaches and the distribution approaches which accompany an image and speech 
information, such as the setting approach of a hyperlink, the usage of other equipments, etc. for 
distribution, and the image and the voice which are reproduced, is shown, in the above- 
mentioned approach, there is no difference in distribution, and the art of the assignment 
information on an image and voice and the art of accompanying information reproduce. 
[0005] For example, by SMIL, the assignment information and accompanying information on an 
image and voice which are distributed and reproduced are described by the same location. 
Moreover, the assignment information and accompanying information on an image and voice 
which a program refers to and which are distributed and reproduced as a database are. described 
by JavaScript and CGI in the program same as the same information. 
[0006] 
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* NOTICES * 
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damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



EFFECT OF THE INVENTION 



[Effect of the Invention] As explained above, when distributing an image and voice on a 
comlmjnica^^ distribution or regeneration of 

an image and speech information, the message distribution processing of accompanying 
information becomes possible. Therefore, during playback of an image and voice, even when 
modification of accompanying information arises, the modification information on accompanying 
information can be distributed from server equipment to client equipment. 
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* NOTICES * 

~JPO and'NCIPl are not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



TECHNICAL PROBLEM 



[Problem(s) to be Solved by the Invention] As mentioned above, in the playback approach of an 
image and speech information, and the method of treating accompanying information, during 
^playback of an image or.yoipe, when .especially broadcasting live junction and a radio 
broadcasting on a network, support information on a link was not able to be changed in client 
equipment. 

[0007] If an example is given, in SMIL, client equipment will acquire the information about all 
accompanying information from server equipment at the time of playback initiation of an image. 
Therefore, when accompanying information was changed after playback initiation, accompanying 
information was not already able to be acquired from server equipment, and the contents of 
modification were not able to be notified to the client equipment which is reproducing an image, 
and voice. 

[0008] In JavaScript, since the WWW browser acquired the contents of all accompanying 
information at the time of acquisition of the information on HTML, the contents of modification 
of accompanying information were not able to be notified to client equipment for the same 
reason. 

[0009] Moreover, although it was possible to have notified modification of accompanying 
information to client equipment by specifying a CGI program as the display contents of a WWW 
browser as a link place when using CGI, the synchronization with the timing which sends 
modification of accompanying information from server equipment, and the timing to which client 
equipment reproduces an image and voice was not taken. 

[0010] This invention solves the problem produced when an image and speech information were 
distributed on a communication network using a Prior art that where of modification of 
accompanying information cannot be performed during playback of an image and voice, 
modification of accompanying information notifies to client equipment during playback of an 
image and voice, and it aims at making it possible to take a synchronization to playback of an 
image and voice, and modification of accompanying information. 
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♦ NOTICES * 

"JPO and~NCIPI are not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



MEANS 



[Means for Solving the Problem] In order to attain the above purpose, this invention distributes 
an image and speech information from server equipment to client equipment on a communication 
-network, performs_distribution and reception. of. accompanying information apart from an image 
and speech information in the reproduced image and the voice distribution approach, and is 
characterized by enabling it to notify distribution of accompanying information, and modification 
between server equipment and client equipment during playback of an image or voice. 
[0012] The means which has each following function in order to enable it to make distribution 
and modification of accompanying information between server equipment and client equipment 
during playback of an image or voice as mentioned above is formed in server equipment and 
client equipment. 

[0013] An accompanying information storage means to hold and accumulate accompanying 
information including the information about the approach of complementing the contents of an 
image and speech information by accompanying an image and speech information and using the 
function of an external device for server equipment for every parts of an image and voice, An 
accompanying information distribution demand receiving means to receive the accompanying 
information distribution demand from client equipment, an accompanying information distribution 
means to distribute accompanying information, and management of the accumulated 
accompanying information and the accompanying information distribution control means which 
manages distribution of accompanying information are prepared. 

[0014] Moreover, an accompanying information distribution demand transmitting means to require 
distribution of accompanying information of client equipment at server equipment based on a 
demand of a user, The image and a voice playback location extract means to gain the playback 
location of an image and voice when a distribution demand of accompanying information is 
transmitted. An accompanying information receiving means to receive the accompanying 
information distributed from server equipment. The accompanying information control means 
which takes the synchronization with the playback location of an image and voice where the 
received accompanying information is decoded and accompanying information corresponds, and 
the playback image and voice location which are actually reproduced. The accompanying 
information actuation means for choosing the external device used from an accompanying 
information-display means to display the received accompanying information, and the input and 
accompanying information-display means of a distribution demand from the user of 
accompanying information, An external device control means to start an external device based 
on the input from an accompanying information actuation means is established. 
[0015] The operation of this invention is as follows. In the accompanying information distribution 
demand transmitting means of client equipment and the accompanying information distribution 
demand receiving means of server equipment, in server equipment and client equipment with an 
above-mentioned means, the distribution demand of an image and speech information has 
transmitted the distribution demand of accompanying information independently to server 
equipment from client equipment. In server equipment, an accompanying information storage 
means, an accompanying information distribution control means, and an accompanying 
information distribution means are performing message distribution processing of accompanying 
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information, and are distributing accompanying information independently with the message 
distribution processing of an image and speech information. 

[0016] On the other hand, in client equipment, it is establishing an accompanying information 
receiving means and an accompanying information control means, and is the reception of an 
image and speech information performing reception of accompanying information independently, 
and establishing an accompanying information-display means, an accompanying information 
actuation means, and an external device control means, and playback of an image and voice is 
using the external device independently. 

[0017] Therefore, it becomes possible [ distribution of an image and speech information, or 
reproductive processing ] independently to perform distribution or reception of accompanying 
information, and server equipment and client equipment enable to notify modification of 
accompanying information to client equipment during distribution of an image and speech 
information, or playback, and it becomes possible at this invention to take playback of an image 
and voice and the synchronization of modification of accompanying information in client 
equipment. 

[0018] A program for a computer to realize each processing means of the server equipment of a 
more than and client equipment is storable in suitable record media, such as portable medium 
memory which a computer can read, semiconductor memory, and a hard disk. 
[0019] 

[Embodiment of the Invention] Hereafter, the gestalt of operation of this invention is explained 
using drawing. Drawing 1 is drawing showing the example of a configuration of the server 
equipment concerning this invention, and drawing 2 is drawing showing the example of a 
configuration of the client equipment concerning this invention. Server equipment 10 and client 
equipment 20 are connected via a communication network 100. Generally, two or more client 
equipments 20 are connected to the communication network 100. 

[0020] The image and a speech information are recording means 101 by which server equipment 
10 accumulates an image and speech information as shown in drawing 1 , The image and the 
speech information distribution control means 102 which controls distribution of an image and 
speech information. The image and a speech information distribution demand receiving means 
1 03 to receive the image and speech information distribution demand from client equipment 20, 
The image and a speech information distribution means 104 to distribute the accumulated image 
and speech information, By accompanying an image and speech information and using the 
function of an external device 30 (not shown) An accompanying information storage means 111 
to accumulate and hold accompanying information including the information about the approach 
of using the external device 30 for complementing the contents of an image and speech 
information, for every parts of an image and speech information. It has management of the 
accumulated accompanying information, the accompanying information distribution control means 
112 which manages distribution of accompanying information, an accompanying information 
distribution demand receiving means 1 1 3 to receive the accompanying information distribution 
demand from client equipment 20, and the accompanying information distribution means 114 for 
distributing accompanying information. The image and speech information input means from a 
camera etc. other than the image and speech information are recording means 101 instead of 
above-mentioned image and speech information are recording means 101 can also be used. 
[0021] Although not necessarily limited to that it is not necessarily explained below that uses 
the function of an external device 30 here, it is using the Internet telephone of the specific 
message place related to the part under the playback, or accessing a specific homepage by the 
WWW browser, or accessing a specific FTP (File Transfer Protocol) server, and transmitting or 
gaining a certain file, for example during playback of a certain image and voice. 
[0022] As shown in drawin g 2 , client equipment 20 The playback image and a voice output 
means 201 to output the reproduced image and voice. The image and a speech information 
actuation means 202 to operate the distributed image and speech information. The playback 
control means 203 which controls playback of the distributed image and speech information. The 
image and a speech information distribution demand transmitting means 204 to transmit an image 
and a speech information distribution demand to server equipment 10, The image and a speech 
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information receiving means 205 to receive the distributed image and speech information. The 
image and a voice playback location extract means 206 to gain an image and a voice playback 
location when a user gives an acquisition demand of accompanying information during an image 
and voice playback, An accompanying information actuation means 21 1 to choose the external 
device 30 which inputs a distribution demand of the accompanying information from a user, and 
is used from the accompanying information-display means 212, The received accompanying 
information The accompanying information control means 213 which takes the synchronization 
with an accompanying information-display means 212 to display, and the image and voice 
playback location where the received accompanying information is decoded and accompanying 
information corresponds, and the image and voice playback location which the playback control 
means 203 is actually reproducing. An accompanying information distribution demand 
transmitting means 214 to require distribution of accompanying information of server equipment 
10 based on a demand of a user. It has an accompanying information receiving means 215 to 
receive the accompanying information distributed from server equipment 1 0, and an external 
device control means 216 to start an external device 30 based on the input from the 
accompanying information actuation means 211. 

[0023] For example, as accompanying information which accompanies the parts of the image and 
speech information under playback, it is (a). When using an Internet telephone for an external 
device sImMc*** point information and (b) The connection place information when using a WWW 
browser for an external device, and (c) When connection place information . when using a FTP 
server for an external device is set up. When the accompanying information actuation means 21 1 
inputs a use demand of accompanying information from a user, the accompanying information- 
display means 212 By the notice from the accompanying information actuation means 21 1, it is 
based on the accompanying information at that time, and is (a) as an available external device. 
An Internet telephone and (b) A WWW browser and (c) It indicates that there is a FTP server. If 
a user chooses an external device with the accompanying information actuation means 211. to 
the external device control means 216, the accompanying information at that time and a users 
selection information will be notified, and the external device control means 216 will call the 
external device 30 which the user chose based on the notified accompanying information. 
[0024] As a means about distribution of the image and speech information in server equipment 
10 and client equipment 20, mounting of for example, the following (1) - (3) is possible. 
[0025] (1) The image and the speech information distribution demand transmitting means 204 of 
client equipment 20 transmit an image and a speech information distribution demand to server 
equipment 10. The image and the speech information distribution means 104 of server equipment 
10 distribute all the information on an image and speech information to client equipment 20, 
before the playback control means 203 of client equipment 20 starts playback of an image and 
voice. 

[0026] (2) The image and the speech information distribution demand transmitting means 204 of 
client equipment 20 transmit an image and a speech information distribution demand to server 
equipment 10. When server equipment 10 starts distribution of an image and speech information, 
the playback control means 203 starts playback of an image and voice at the same time client 
equipment 20 receives a part of image and speech information. 

[0027] (3) The image and the speech information distribution demand transmitting means 204 of 
client equipment 20 transmit an image and a speech information distribution demand to server 
equipment 10. The image and the speech information distribution means 104 of server equipment 
10 distribute the image and speech information of these contents to coincidence to the unit or 
two or more client equipments 20 which gave the image and the speech information distribution 
demand to server equipment 10. 

[0028] Moreover, mounting offer example, the following (1) - (5) is possible as a means about 
distribution of the accompanying information in server equipment 1 0 and client equipment 20. 
[0029] (1) The accompanying information distribution demand transmitting means 214 of client 
equipment 20 transmits a distribution demand of accompanying information to server equipment 
10 at the time of playback initiation of an image and speech information. The accompanying 
information distribution control means 1 12 of server equipment 10 and the accompanying 
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information distribution means 114 will distribute required accompanying information to client 
equipment 20 before playback initiation of the image and voice of client equipment 20, if an 
accompanying information distribution demand is received. 

[0030] (2) The accompanying information distribution control means 1 1 2 of server equipment 1 0 
and the accompanying information distribution means 114 continue distributing accompanying 
information at fixed spacing. Moreover, the accompanying information control means 213 of 
client equipment 20 compares the accompanying information distributed at fixed spacing with the 
accompanying information acquired at the time of transmission of an image voice delivery 
information demand, and when these differ, it changes accompanying information. 
[0031] (3) The accompanying information distribution demand transmitting means 214 of client 
equipment 20 advances a distribution demand of accompanying information to server equipment 
10 at the time of playback initiation of an image and speech information. If a distribution demand 
of accompanying information is received, the accompanying information distribution control 

.means_JJ.2 of server, equipment 1 0 and the_ac.companying_jnformation distribution means 114 will 
synchronize, will perform distribution of an image and speech information, and distribution of 

"^accompanying information, and will~distribute"the~accompanying information" corresponding to 
each part of an image to client equipment 20. 

[0032] (4) The image and the voice playback location extract means 206 of client equipment 20 
acquire an image and voice playback positional information, when a user gives an acquisition 
demand of accompanying information during playback of an image and speech information. 
Moreover, the accompanying information distribution demand transmitting means 214 transmits a 
distribution demand of the accompanying information accompanied by the acquired image and 
voice playback positional information to server equipment 10. The accompanying information 
distribution means 1 14 of server equipment 10 will distribute the accompanying information 
corresponding to the received image iand voice playback location, if this distribution demand is 
received. 

[0033] (5) When modification arises to accompanying information, the accompanying information 
distribution control means 1 12 of server equipment 10 recognizes that modification arose, and 
directs distribution of the accompanying information which the modification produced for the 
accompanying information distribution means 114. The accompanying information distribution 
means 114 distributes the accompanying information which modification produced to client 
equipment 20, when the notice of modification of accompanying information is received from the 
accompanying information distribution control means 112. 

[0034] By each of these means, this invention has the accompanying information distribution 
function that the server equipment 10 which an image and speech information distributed, and 
client equipment 20 transmitted an accompanying information distribution demand to server 
equipment 10 in addition to the image and the voice distribution regenerative function to which 
client equipment 20 reproduces an image and voice, and received a distribution demand 
distributes accompanying information, and the external device starting function that client 
equipment 20 calls an external device 30 based on accompanying information, in server 
equipment 10. Below, the flow of the processing in the gestalt of each operation is explained. 
[0035] [Gestalt of the 1 st operation] Drawing 3 is drawing for explaining the flow of the 
processing in the gestalt of the 1 st operation. The flow of the processing shown in drawing 3 
between server equipment 1 0 and client equipment 20 When an image and a speech information 
distribution demand are transmitted from client equipment 20 to server equipment 10 Client 
equipment 20 playback of an image and voice Before starting, when all the information on image 
information and accompanying information is distributed to client equipment 20 from server 
equipment 10. and accompanying information is periodically distributed to client equipment 20 
from server equipment 10 and modification arises to accompanying information, modification of 
accompanying information In the approach of performing, it is a thing when using accompanying 
information. 

[0036] If an image and a speech information distribution demand signal, and an accompanying 
information distribution demand signal are transmitted to server equipment 10 from the image 
and the speech information distribution demand transmitting means 204 of client equipment 20, 
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the image and the speech information distribution demand receiving means 1 03 of server 
equipment 10, and the accompanying information distribution demand receiving means 113 will 
receive each signal (S101, S102). Server equipment 10 will distribute all the demanded required 
information on an image and speech information to client equipment 20 from an image and the 
speech information distribution means 104, if an image and a speech information distribution 
demand signal are received (SI 03). All the information on the accompanying information which 
accompanies the image and speech information to distribute is also then distributed to client 
equipment 20 from the accompanying Information distribution means 114 at coincidence (SI 04). 
[0037] With client equipment 20, an image and the speech information receiving means 205. and 
the accompanying information receiving means 215 receive all images and speech information, 
and all accompanying information, respectively, and playback of an image and voice is started 
(SI 05). However, when the demanded image and speech information, or accompanying 
information is not distributed, client equipment 20 transmits a resending demand of an image and 
speech information, and accompanying information to server equipment 10 from an image and 
the speech information distribution demand transmitting means 204, and the accompanying 
information distribution demand transmitting means 214, respectively, and requires distribution of 
an image and speech information, or accompanying information from server equipment 10 again. 
[0038] Server equipment 10 distributes accompanying information to client equipment 20 from 
the accompanying information distribution means 114 at fixed spacing. The accompanying 
information control means 213 of client equipment 20 performs the comparison with the 
accompanying information which acquired to the Image and the speech-information distribution 
demand whenever the accompanying information receiving means 215 received accompanying 
information, and the accompanying information which newly received, and when the 
accompanying information which acquired to an image and the speech-information distribution 
demand differs from the accompanying information which newly received, the accompanying 
information hold replaces to the accompanying information newly received (SI 06). 
[0039] A user inputs the use demand of the function of an external device 30 into client 
equipment 20 from the accompanying Information actuation means 21 1 , when checking a 
playback image and voice and using the function of an external device 30 (S107). If the use 
demand of the function of an external device 30 is inputted, the playback control means 203 will 
suspend playback of an image and voice, and will pass playback halt positional information to an 
image and the voice playback location extract means 206 (SI 08, SI 09). Playback halt positional 
information is also passed at coincidence to the accompanying information control means 213. 
[0040] If playback halt positional information is received, the accompanying information control 
means 213 will be referring to playback halt positional information with reference to the 
accompanying information received from server equipment 10, and it will opt for the action (it is 
henceforth called external information starting conditions) which should perform an external 
device 30 (S1 10). 

[0041] If external information starting conditions are determined, the accompanying information 
control means 21 3 will pass external information starting conditions to the external device 
control means 216. The external device control means 216 will start an external device 30 based 
on external Information starting conditions, if external Information starting conditions are 
received. 

[0042] for example, if elapsed time sets to Lt (0<Lt<L1) when recognizing each part of an image 
and voice by the elapsed time from playback Initiation, If accompanying Information as shown in 
drawing 4 is taken for an example, it will Judge from the specific information of Location — 
information[0] 401 become effective. When the user has chosen the WWW browser as an 
external device 30 at this time, a WWW browser opens URL of http://www.'MwMt***** according 
to the parameter of ''Browser[0] =http://www.**=MoMc**3|c'' currently written to informatlon[0] 
401 of accompanying information (S1 1 1). 

[0043] If external information starting conditions are determined, the accompanying information 
control means 213 will pass external information starting conditions to the external device 
control means 216. If external information starting conditions are received, the external device 
control means 216 will start an external device 30 based on external information starting 
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conditions (S1 12). 

[0044] If a user suspends use of an external device 30. the external device control means 216 
will detect the terminate signal of an external device 30 (S1 13). The external device control 
means 216 will advance the resumption demand of playback to the playback control means 203. 
if the terminate signal of an external device 30 is detected. If the resumption demand of playback 
is received, the playback control means 203 will acquire playback halt positional information from 
an image and the voice playback location extract means 206. and will resume playback from a 
playback halt location (S1 14). 

[0045] As mentioned above, with the gestalt of this operation, client equipment 20 receives 
accompanying information periodically. Thereby, when modification arises to accompanying 
information, client equipment 20 acquires the changed accompanying Information from server 
equipment 10, and the synchronization with playback of the image and voice in client equipment 
20 and the changed accompanying information of it is attained. 

[0046] [Gestalt of the 2nd operation] Drawing 5 is drawing for explaining the flow of the 
processing in the gestalt of the 2nd operation. The flow of the processing shown in drawing 5 is a 
— thing when using accompanying information, when an image and a speech information distribution 
demand are transmitted from client equipment 20 to server equipment 10 between server 
equipment 10 and client equipment 20. and starting playback of an image and voice at the same 
time client equipment 20 receives the image information and the accompanying information 
distributed from server equipment 10. 

[0047] If an image and a speech information distribution demand signal, and an accompanying 
information distribution demand signal are transmitted to server equipment 10 from the image 
and the speech information distribution demand transmitting means 204 of client equipment 20, 
the image and the speech information distribution demand receiving means 1 03 of server 
equipment 10, and the accompanying information distribution demand receiving means 113 will 
receive these signals, respectively (S201, S202). Server equipment 10 will distribute continuously 
the demanded image and speech information to client equipment 20 from an image and the 
speech information distribution means 104, if an image and a speech information distribution 
demand signal are received (S203). The accompanying information which accompanies the image 
and speech information to distribute is also then distributed to client equipment 20 continuously 
from the accompanying information distribution means 1 1 4 at coincidence (S204). 
[0048] Client equipment 20 will start playback of an image and voice to reception and 
coincidence, if an image and the speech information receiving means 205, and the accompanying 
information receiving means 21 5 receive an image and speech information, and accompanying 
information, respectively (S205). However, when the existence of loss of the information sent on 
a communication network 100 is checked and informational loss is accepted, client equipment 20 
transmits a resending demand of the information lost to server equipment 10 about each of an 
image and speech information, or accompanying information from an image and the speech 
information distribution demand transmitting means 204, and the accompanying information 
distribution demand transmitting means 214. 

[0049] Moreover, before reproducing an image and voice, it is necessary to do the activity which 
takes the synchronization with the image and speech information, and accompanying information 
which were distributed. Therefore, an image, speech information, and accompanying information 
need to be beforehand acquired, in case an image and voice are reproduced, and acquisition of 
an image, speech information, and accompanying information is performed in advance of playback 
of an image and voice. For example, if the time amount for 3 seconds is required for the 
synchronization of processing of a resending demand of information, an image and speech 
information, and accompanying information, as for client equipment 20, the image and speech 
information for 3 seconds, and accompanying information will be acquired before playback of an 
image and voice at least. 

[0050] A user inputs the use demand of the function of an external device 30 into client 
equipment 20 from the accompanying information actuation means 21 1. when checking a 
playback image and voice and using the function of an external device 30 (S206). If the use 
demand of the function of an external device 30 is inputted, the playback control means 203 will 
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pass the playback positional information at the time of the use demand of the function of an 
external device 30 being inputted to the accompanying information control means 213 (S207, 
S208). 

[0051] If playback positional information is received, with reference to the accompanying 
information received from server equipment 10, the accompanying information control means 213 
will be referring to playback positional information, and will determine external information 
starting conditions (S209). 

[0052] If elapsed time sets to Lt (0<Lt<L1) when recognizing each part of an image and voice by 
the elapsed time from playback initiation, if the accompanying information shown in drawing 4 is 
taken for an example, information[0] 401 will become effective. When the user has chosen the 
WWW browser as an external device 30 at this time, a WWW browser opens URL of 
http://www.********* according to the parameter of "Browser[0] =http://www.'M«*»MaMcaMc'' 
currently written to information[0] 401 of accompanying information (S210). 
.[0053] If external information starting conditions are determined, the accompanying information 
control means 213 will pass external information starting conditions to the external device 
* control means 216. If external information starting conditions are received, the external device 
control means 216 will start an external device 30 based on external information starting 
conditions (S211), ^ ........ . 

[0054] A user s halt of use of an external device 30 checks that the external device control 
means 216 detected the terminate signal of an external device 30, and the external device 30 
has ended it (S212). 

[0055] As mentioned above, with the gestalt of this operation, client equipment 20 receives 
accompanying information continuously. Thereby, when modification arises to accompanying 
information, client equipment 20 acquires the always changed accompanying information from 
server equipment 1 0, and the synchronization with playback of the image and voice in client 
equipment 20 and the changed accompanying information of it is attained. 
[0056] [Gestalt of the 3rd operation] Drawing 6 is drawing for explaining the flow of the 
processing in the gestalt of the 3rd operation. The flow of the processing shown in drawing 6 
between server equipment 10 and client equipment 20 When an image and a speech information 
distribution demand are transmitted from client equipment 20 to server equipment 10 When all 
the information on image information is distributed to client equipment 20 from server equipment 
10 before client equipment 20 started playback of an image and voice, and the use demand of 
the function of an external device 30 is inputted from a user about accompanying information It 
is a thing when using accompanying information in the approach of transmitting a distribution 
demand to chisel server equipment 10, and distributing to client equipment 20. 
[0057] If an image and a speech information distribution demand signal are transmitted to server 
equipment 10 from the image and the speech information distribution demand transmitting means 
204 of client equipment 20. the image and the speech information distribution demand receiving 
means 103 of server equipment 10 will receive an image and a speech information distribution 
demand signal (S301). Server equipment 10 will distribute the demanded information on an image 
and speech information to client equipment 20 from an image and the speech information 
distribution means 104, if an image and a speech information distribution demand signal are 
received (S302). 

[0058] If an image and the speech information receiving means 205 receive all images and 
speech information, client equipment 20 will start playback of an image and voice (S303). 
However, when the demanded image and speech information are not distributed, client equipment 
20 transmits a resending demand of an image and speech information, and accompanying 
information to server equipment 10 from an image and the speech information distribution 
demand transmitting means 204, and the accompanying information distribution demand 
transmitting means 214, respectively, and requires distribution of an image and speech 
informati'on, or accompanying information from server equipment 10 again. 
[0059] A user inputs the use demand of the function of an external device 30 into client 
equipment 20 from the accompanying information actuation means 21 1, when checking a 
playback image and voice and using the function of an external device 30 (S304). If the use 
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demand of the function of an external device 30 is inputted, the playback control means 203 will 
pass the image and voice playback positional information at the time of the use demand of the 
function of an external device 30 being inputted to the accompanying information control means 
-213(8305. S306). 

[0060] If playback positional information is received, the accompanying information control 
means 213 will transmit a distribution demand of accompanying information from the 
accompanying information distribution demand transmitting means 214 while transmitting an 
image and voice playback positional information to server equipment 10 (S307). If an image and 
voice playback positional information, and an accompanying information distribution demand are 
received with the accompanying information distribution demand receiving means 113, sender 
equipment 10 will decide the accompanying information which should be distributed to client 
equipment 20 based on an image and voice playback positional information, and will distribute 
accompanying information from the accompanying information distribution means 114 (S308). 
However, when the demanded accompanying information is not distributed, client equipment 20 
transmits a resending demand of accompanying information from the accompanying information 
"distribution demand transmitting means 214' to"server~e'quipment"10, and requires^distribution of 
accompanying information from server equipment 1 0 again. 

[0061] If the accompanying information receiving means 215 receives accompanying information, 
external information starting conditions will be determined based on accompanying information 
(S309). If external device starting conditions are determined, the accompanying information 
control means 213 will pass external information starting conditions to the external device 
control means 216. If external information starting conditions are received, the external device 
control means 216 will start an external device 30 based on external information starting 
conditions. 

[0062] If elapsed time sets to Lt (0<Lt<L1) when recognizing each part of an image and voice by 
the elapsed time from playback initiation, if the accompanying information shown in drawing 4 is 
taken for an example, information[0] 401 will become effective. When the user has chosen the 
WWW browser as an external device at this time, a WWW browser opens URL of 
http://www.********* according to the parameter of "Browser[0] =http://www.*********'' 
currently written to information[0] 401 of accompanying information (S310). 
[0063] If external information starting conditions are determined, the accompanying information 
control means 213 will pass external information starting conditions to the external device 
control means 216. If external information starting conditions are received, the external device 
control means 216 will start an external device 30 based on external information starting 
conditions (S31 1). 

[0064] A user s halt of use of an external device 30 checks that the external device control 
means 216 detected the terminate signal of an external device 30, and the external device 30 
has ended it (S3 12). 

[0065] As mentioned above, with the gestalt of this operation, although client equipment 20 does 
not hold accompanying information in advance, it acquires accompanying information by requiring 
distribution of accompanying information of server equipment 10 according to the demand from a 
user. Consequently, when modification arises to accompanying information, client equipment 20 
acquires the changed accompanying information which server equipment 10 has. and the 
synchronization with playback of the image and voice in client equipment 20 and the changed 
accompanying information of it is attained. 

[0066] [Gestalt of the 4th operation] Drawing 7 is drawing for explaining the flow of the 
processing in the gestalt of the 4th operation. The flow of the processing shown in drawing 7 
between server equipment 10 and client equipment 20 When an image and a speech information 
distribution demand are transmitted from client equipment 20 to server equipment 10 When 
client equipment 20 started playback of an image and voice, accompanying information acquires 
all required information from server equipment 10 before client equipment 20 started playback of 
an image and voice and modification of accompanying information arises at the same time it 
receives the image information distributed from server equipment 10 When server equipment 10 
distributes "M^ and its modification information to client equipment 20. it is a thing when using 
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accompanying information. 

[0067] If an image and a speech information distribution demand signal, and an accompanying 
information distribution demand signal are transmitted to server equipment 10 from the image 
and the speech information distribution demand transmitting means 204 of client equipment 20, 
the image and the speech information distribution demand receiving means 103 of server 
equipment 10. and the accompanying information distribution demand receiving means 113 will 
receive, respectively (S401, S402). Server equipment 10 will distribute the demanded image and 
speech information to client equipment 20 from an image and the speech information distribution 
means 104, if an image and a speech information distribution demand signal are received. All the 
information on the accompanying information which accompanies the image and speech 
information to distribute is also then distributed to client equipment 20 from the accompanying 
information distribution means 114 at coincidence (S403, S404). 

[0068] If an image and the speech information receiving means 205 receive an image and speech 
information, client equipment 20 will .start playback of an image and voice (S405). However, when 
the existence of loss of the information sent on a communication network 100 is checked and 
"informational loss is~acceptedrclient^equipment 20 transmits a resending demand"of the 
information lost to server equipment 10 about each of an image and speech information, and 
accompanying information from an image and the speech information distribution demand 
transmitting means 204, and the accompanying information distribution demand transmitting 
means 214. 

[0069] Moreover, it is necessary to do the activity which takes the synchronization with the 
image and speech information, and accompanying information which were distributed before 
playback of an image and voice. Therefore, in case an image, speech information, and 
accompanying information reproduce an image and voice, they need to be acquired beforehand, 
and acquisition of an image, speech information, and accompanying information is performed In 
advance of playback of an image and voice. For example, if the time amount for 3 seconds is 
required for the synchronization of processing of a resending demand of information, an image 
and speech information, and accompanying Information, as for client equipment 20. the image and 
speech information for 3 seconds, and accompanying information will be acquired before 
playback of an image and voice at least. 

[0070] Server equipment 10 will distribute the changed accompanying information from the 
accompanying information distribution means 1 14 to client equipment 20, if modification of the 
accompanying information accumulated in the accompanying information storage means 1 1 1 is 
detected by the accompanying information distribution control means 112. Client equipment 20 
performs the comparison with the accompanying information which acquired to an image and a 
speech-information distribution demand when the accompanying information receiving means 
215 received the changed accompanying information, and the accompanying information which 
newly received, and when the accompanying information which acquired to an image and a 
speech-information distribution demand differs from the accompanying information which newly 
received, it replaces the accompanying information hold to the accompanying information newly 
received (S406). 

[0071] A user inputs the use demand of the function of an external device 30 into client 
equipment 20 from the accompanying information actuation means 211, when checking a 
playback image and voice and using the function of an external device (S407). 
[0072] If the use demand of the function of an external device 30 is inputted, the playback 
control means 203 will pass the playback positional information of the image and voice at the 
time of the use demand of the function of an external device 30 being inputted to the 
accompanying information control means 213 (S408, S409). 

[0073] If playback positional information is received, with reference to the accompanying 
information received from server equipment 10, the accompanying information control means 213 
will be referring to playback positional information, and will determine external information 
starting conditions (S410). 

[0074] If elapsed time sets to Lt (0<Lt<L1) when recognizing each part of an image and voice by 
the elapsed time from playback initiation, if the accompanying information shown in drawing 4 is 
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taken for an example, information[03 401 will become effective. When the user has chosen the 
WWW browser as an external device 30 at this time, a WWW browser opens URL of 
http://www.********* according to the parameter of "Browser[0] =http://www.*********" 
currently written to information[0] 401 of accompanying information (S411). 
[0075] If external information starting conditions are determined, the accompanying information 
control means 213 will pass external information starting conditions to the external device 
control means 216. If external information starting conditions are received, the external device 
control means 216 will start an external device 30 based on external information starting 
conditions (S41 2). 

[0076] A user s halt of use of an external device 30 checks that the external device control 
means 216 detected the terminate signal of an external device 30. and the external device 30 
has ended it (S413). 

[0077] As mentioned above, with the gestalt of this operation, client equipment 20 receives the 
new accompanying information changed at the time of modification of accompanying information. 
Thereby, when modification arises to accompanying information, client equipment 20 acquires the 
changed accompanying information from server equipment 10. and the synchronization with 
playback of the image and voice in client equipment 20 and the changed accompanying 
information of it is attained. - . . - 

[0078] In addition, in the above explanation, it cannot be overemphasized that both of an image 
and voice are sufficient as either an image or voice. Moreover, although explanation of the 
gestalt of the above-mentioned implementation explained the example which distributes the 
image and speech information accumulated beforehand, in distribution of the image and speech 
information which has time constraint by distribution, for example from an information input like 
play-by-play broadcasting, this invention is applicable similarly. 
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* NOTICES * 

JPO and NCI PI are not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is drawing showing the example of a configuration of server equipment. 
[Drawing 2] It is drawing_shpwing the .exajmple of _a configuration of client equipment 
[Drawing 3] It is drawing for explaining the flow of the processing in the gestalt of the 1 st 
operation. 

[Drawing 4] It is drawing showing the example of accompanying information. 

[Drawing 5] It is drawing for explaining the flow of the processing in the gestalt of the 2nd 

operation. 

[Drawing 6] It is drawing for explaining the flow of the processing in the gestalt of the 3rd 
operation. 

[Drawing 7] It is drawing for explaining the flow of the processing in the gestalt of the 4th 
operation. 

[Description of Notations] 
10 Server Equipment 

101 Image and Speech Information Are Recording Means 

102 Image and Speech Information Distribution Control Means 

103 Image and Speech Information Distribution Demand Receiving Means 

104 Image and Speech Information Distribution Means 

111 Accompanying Information Storage Means 

112 Accompanying Information Distribution Control Means 

113 Accompanying Information Distribution Demand Receiving Means 

114 Accompanying Information Distribution Means 
20 Client Equipment 

201 Playback Image and Voice Output Means 

202 Image and Speech Information Actuation Means 

203 Playback Control Means 

204 Image and Speech Information Distribution Demand Transmitting Means 

205 Image and Speech Information Receiving Means 

206 Image and Voice Playback Location Extract Means 

211 Accompanying Information Actuation Means 

212 Accompanying Information-Display Means 

213 Accompanying Information Control Means 

214 Accompanying Information Distribution Demand Transmitting Means 

215 Accompanying Information Receiving Means 

216 External Device Control Means 
100 Communication Network 
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^^■c, iiriBi*— /^sai*. Kfefli • «?5ftai=#ia-r«« 

:&^i:lif sit »$#t;f*Ri18a*, Emf-58*« 
^mm<r>^^i^m^9km,. itrie^ ^ -r t > hssjb^ & 

SL, *<oa, S»iMI=f*lffi«ffl*E«L, 

t^r. «(ria-9— /«sai*. • ^^it^iC'Wra-rsif 
^1Sffl(0«-8P«'Si-'Slt L, ffris^ 5 -r T :^ ksm*^ & 

tii*« 3 J R!fc« • Eli-r 4-9— /<sa 

ASSAYS. E«**ifctt« • #?5««$am 



«-cft-3r, HSssa<oate$fijffl-r*:ii:icj:y8ife« 
• e?&if«<Drt§*«^-rsfctoa)nsssa*fjffl-r« 

L. ltFE'5' 7 •< T > KSS*^ t. 
IA« • -t^S£iiaif«$liSL/=#lffi1t«l(0Sm3l:i£ 

*eit«A:, *<©^>7'fT>h3sar=»tT, -toifttfi 

-fTV hSa^EML, l5E^7 7-fT>hSai*. flE 

|SWSfia««S# 5 #ra««<DEffiS?« * I5E-9— A 
Sa-^SHIL., ltJE-9— /<saA^t,ftrais«$s<iL. 

Lm±r^<7^^7>hmnt. itrE-9— /^satiirE 
;^7-fT>i>sat*»fii-r«a«*'y h^-^^ti^a 

t^-c. liTE-y— /^gatt. tt« • ^p«ai:#pa-r*« 
ffi-eftoT, »i>9sa(o«fie$fijffl-r«c^(=j:yRfctt 

pit«ro«-s»si=«j# u, V -f T > hsaA^ €> 
#iait«a>s@s«$sit«^. "eco^^-fr^Ksa 

ftBt1f«*l5E^7 7-fr>hS®lcEmL, flE^^^'C 

Tvhgai*. fiTE-y— /<gai=«urBft« • 
<OE<iS**Sim-r*i:i:tl=, fSE-y— /<sai=i»* L 

fsmon^mz. ifrE-y— /^saA^&s&sftttfsiiss* 
s<iL. SM©flfei:fc«iffiitaA<«trE-y— /<saA^&E 
<i * *if= t # 1= tttj t^#lfflfll« *«f L t^f*ittiiiai=a # 
nse^aoeti$fijffi-r^^^f=E«$tiy-=ssr 

Lff^-r«^^-f Tvhsai:. itTE-y— /N'sairiaE 
nfissa(Dafig$9jffi-r«c^i=<): uk« ■ #^iim<D 
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■ §i&«s<oiB^M«ssitT, turn ' 'S^mm^-m 
Lr, *fctt#fip»cri:ic«SLTe^i-ri)#®t. fir 

mmmt^m-tiz. idE-y— /^gsA^&Em^tifcs 
iK^EeLfcESJKft-c&o-c, ie^-r4Bft« • 

ri:i=««LTEfi-r««k3at, lijE^ 5-fr>hsa 

TVhSaA^&OftfffllSSroE^tS^I^StUr, I(IE^7 

#iffi«ffl*Eifr«, *fci*i9E^'^-fr>haa*^& 
>>;^7^Ai=tei+«-9— /<aa«>:'n^^5A*E«LfcE 



fcE®«Ett:-Ci&oT. WE*- /<Sai=*tLr«!fe«-§ 

URftft ■ wpiffa(Di^@$«i^-r«fr«>(onffisia$ftj 

S**iaE-9— /<Sai::»L2Hl-r-5. *fcl*E<l*H 

#i=, WE-y— Asai=»Ltt«-«^if^eais«* 

t^■#«(-ll^T $ -a- -5 □ ^ AES L fc c t ^!Sia t -r 

hSaro ::^o ^ ASES LfcESJSft:. 

[000 1] 
■5. 

[0002] 

a<Dateo«fflsr^*3as-r«*a*<ff«-r-s. 

[0 0 0 3] ^(D-^mtLXlt. *V h-?— ^7±T?R*« 

?t5WWW3>V— >rA (W3C) ^<S«>SM I Lie 

Lf=tet^T«»<D«fe« • «FCD««*It5 JavaScriptAf> 
CG I (Conmon Gateway Interface) iZit^tStl^'^O 

[0O0 4] ±Ea>«^i=fei^-c, S@-W±$4l«lft 

[OOO5]0l^if. SM I L7?M:. Em • S±-r^^ 
Tt^^, JavaScript, CGIT?tt, ^O^f^AO) 

y^ArtUEa^*lrt^4, 
[0006] 
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[0007] «*fclf«t, SMIL-CI*. ^^^-fT^ 

[0 0 0 8] JavaScripttrjSl^Ttt, VfWWy^ •t7if±l< 
HTML a)1S«©S^^(Z-r'<r <0<*lffi««<7)rtS*jS 

[0 0 0 9] *fc, CG I SflJffi-r^SS^iCtt. www 

[0 0 10] «£*<oatB*ffll>Tii{l*^/ h 

fc, Iftft • #^©S^*(c(4#gi1ta<D^MA<-C#'ECL^ 

[00 11] 

[0 0 1 2] ±e<DJ:5f=tt«*>S?S<OI5^«»=fe«.^r 

[0 0 13] -9— /^gSfctt, • #pmai=#H 
m^SLt. -j^^-f T>hsaii^e>«)«(BissE«s*$ 



[0 0 1 4] *fc, ^^^-rrv hsaiztt, a.—- tF©^ 
Ly=i:#(cw«i • w?^(osi^ia^a^§•r■5B!fc« • 

fltaaat^at, #Rt««<oa.— 9'A^&«Di^^l^l*©A 

fcj:i;#fffi«as*¥s*^&*jffl-r.5*t-SBsa*s 

&(OA:A(=%-^LXTns0sa$en$it«n«9^a$<j{9 

[0 0 1 5] filTroirfcy-pfei., Ji 

i^r, ^7 5 -f T :/ hSfi(D#ittisaE«s«aie*a t 

•9— /<sa©ttraif as^i^^s^i^si*. Rife« • 

^WTVhSEaA^&l*— A*ai=2imL-CL^«. -9— 

^acfea^Tii, #fciitasa#s, #ismaiBm^{si 
[0 0 1 6] — -^^-fT^ hsar=*5t>T(*, #fii 
a, ns«siaeii@^s$sit«c^-e. ukii-^^<ow 

[0 0 1 7] Lfcito-C, *f6ISTfl4, • Wf^lS® 

^fciiSii^fT^citA^Rrigi'EEy, -9— A^a. 

t^-ct. •i7^-fr>hsar=*tLTftBitsa(o^M*® 
a-r^ciA^Rifiit'Sry. ^^-rr^hsaicteu-cBife 

[001 8] eiJ:<7)-9— /<siafc*i;'!>^-r'T> hsa 
tfir«iA«a»stywfi&3%wttiS(»>%9. ^t^sii^ 

>^y. y\-KT-fXi7«:if()!)aa3EEgESafl:l=<«fl-r 
[001 9] 



(5) ^ifl2O0O-2448 8 9 



'y-<7iyhmm<r>m&m^^^-rmx'Sb^. -y— asmi 

[O0 2O1 Hi -9— /<Sei 014, Sfc 

{St • #^it«$ss-r«i(!fe» • #^if«[s«¥si o 1 

O 2 , *?=j-<7 > KSS 2 O <08ft« 

se^ei o 3 i:, #aLfcftfc«i • #^ifffi^Em-rs 
S3 o «fijffl-r«*as(=ii-r«ffi«*#t?#Btwffl*. 

g^Ki lit. SSUfc#S81ta<DtStf=ffffi1tffla> 
iB<i<OgaSfTd«raitSE<i$i|®¥^Sl 1 2i:. ■j;^ 

isi««s«5^s«^ai 1 #iiiiiwffi$s@-r« 

fci&a)#rafiiffiKii¥Sl 1 4i:$#jL-5, ±EWl«- 

w^isass^s 1 o 1 <Dft*3 y ic, ^^ttttfii - 
[002 1] cc-e, >i.ss^a3o<oagg*«ffl-r*i: 

ffJfflLfcy, wwwzf^-tj-tfic^y^SroTh— A'^— V 

l=7^-bXLf=y, ^S<OFTP (File Transfer Prot 
ocol) -9— /<l-T^7-b;?.Lr, fc*77-f;U«lE3ILte 

y Lf= y ^« i: 5 J: 5 * c t 

[O022] H 2 ic^-r * 5 1=. ^'5-frvhSia2o 

Bife« • §isi!}«^f^¥S2 o 2 e<g*+ifca*«! • § 

)»1!l«0!>ll±$«l«|-r«l$^«l»#S2O3£:. WSk' 

pifa£€S3^ii€¥S2 0 4t. £it$tti^efe«i • # 

^fl}S$S@-r««^tt • €^P1ff«[S€^S 2 O 5 1 . Kfc 

^$A^L. #faims^^a2i 2«vig,fij^f «9t>9 
^®3 o^gfi?-r««ifflitagft¥S2 1 1 i:, s<iL 

/=#ltltilS$S^-r€>f>MSm»a^#S2 1 2t, 

s±eatsifsr=s^aw¥^e2 o 3 4tii^uTt^-5efe 

{£ - #FS£«tat(D@»£t«^fSm%«|®^S2 1 



SSI OlzS*^i,f^ra«ffiE<t3I^SIfi^S2 1 4 

i:, -y— /^SSl oAN&EmLT^fc#raifs*sm-r 

«#Bfifl}«lSe^S2 1 St., f>MaifffilSf^^S2 1 1 

A^e.<DA*l=s-^t^r>1.sp^a3 o *fiiii*-e-«^«s 
a$9i9i^S2 1 6 1 ^tix-g. 
[0 0 2 3] «jttfis*«f a)tt« • «?*«iaa)Ss»i=# 
Ri-r«t*rai»at t-c, (a) fi-gpsaci-f K 
mfs$f<jffl-r*<!:#<»afiS5feiss, (w ^i-spsaicww 
-w-T^-^-jj-tf-^ffjffl-r-st^ogs^feiss. (c) ^sB^a 
1= F T p-y—/<*«ffl-r St i^sas* 

^^Tt^S^:#. f*raifagf^^®2 1 lA<i— tfA^6.# 

raitaofufflssR^A^-r-si:, #ffflisaaai^e2 1 
2i*,~#i9w«iaff^S2 1 1 A^&<Daai=«fey, 

i:#a)#iffl^S«l=S•:^I.^T, fUfflRTfig^Jl-SSSai: u 
•C, (a) -<->^—^vVW&, (b) WWWI^^O-tf, 

(c) /Wfc4ct*a5%-i-«. J.—- tf*«#ia 

ffi«^f^^S2i 1 i=j:y9i-ssa£s«;-r-&t, n«P 

^aSi|ffii#S2 1 6l=«Lr. #<0«rai!}ai:i 

— tf©s«<tai:j4<afii*>t, >t-»sa$!i«i¥S2 1 e 
[0 0 2 4] -y— /^sai ofcj:tx^75'rT>hsa2 

99xtfJaT<D (1) ~ (3) OJHSA^RltS-CfcS. 

[0025] (1 ) KSa2 OWffife^- 

1taiBliSI*Sim^S2Q4(*, -9— y^Sai 0(Z«L 
ril*« • W?»fll«E«S3ll*2imr«. -9— ASai O 
<DB**6 • -glSIf llE{t#S 1 O 4 (4. <7 ^ -< T > h^a 
2 0©||^4flffil#a2 O 3A<R*«l • S|S«)||^SPSS-r 

«liri=, tt«-«FSfljaa)^fl}««^^^-f7>h«a2 

o icEif-rio 

(0026] (2) ^77-fr>K«a2 0a)ttfil-«F 

fll«iEmB*SI<i¥«2 o 4 14, -9— /<sia 1 o j=» u 
-C8A« • #|Srftas<ill**2Hl-r*. :S±4g®¥S2 
0 314, -9— /<Sai OA<Sft«-^F31Sffl<DEm*gi*& 
Lfc^f-, 8!fcfii--&^««a)-9»*i?5-fT>KSa 
2 OA<S€-r«t @B$t=Kfeltl ■ $f^(DS±$ntt-r«. 

[0027] (3) ^'^-i'r> hsa2 oroefes • §is 
itaEiis^sm^e 2 o 4 14, -9— /<sa 1 o i=» l 
rtt« ■ §?s««Eeii««sie-r«. -9— /<sai o 

a)B*« • ^^ttSE^i^S 1 o 4 14, -9— ASM 1 o t= 
[00 2 8] *fc. -9^— /<gai ofc<fcu:^^-<T> h 

sa2 oi-te(t4#efii«©Emi-H-r«^si: lt, 
«ji«eiT«) (1) ~ (s) ©*si4»Rrti-ea&*, 

[0029] (1) •>^-<7'>hga2 0<0^*K19«H 

€Sj)$i3iii^a2 1 414. - m^xknoi^^m^^ 



(6) 
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Rfiift^sm^si 1 Ait. nm^m^m^^^sif^ 
t. ^?T-rT>h«a2o©ii*«-e?5<D?f^BiJ&i?r 

[0030] ( 2 ) -y— /^SIS 1 O <DfrH81tffllB«M» 

-ttfffi««*(H»#a-2-i 3 tt. -sfapg-c-iB«**i*#ffi 

fro, 

[00311 (3) >7^^'7'>h»fi2 0«D^*ia««E 

fiS*2lfl^K2 1 41*. tik^ ■ ^^WfflOS^BBJfe^ 
f::. -9— o(=«UT«fffi1tS«)e<ill«*aj 
•r. -9— 0<0#ISI«ffliB<iS!»8¥Sl 1 2i:# 

iaif}«e«^si 1 4 a, ^Kifli««>£«s^ssit« 
ss2oi=iB<t-r«. 

[0032] (4) ^77-f'7'>hSM2 0©B*«-§^ 
^^«tSjaUl^a2 O 6 a, Si^fit • -g^lffffiiOS^tilC 

«. -y— /^SSIttl 0<0#iafll«iB«#Sl 141*. C<D 

[0033] < 5 ) -y— /<»a 1 o a>f>M9if 

1 214, #lffl11iaiz|IMA<^i:fcJS^I=. ^Jgi* 

S1 1 414, nmmmmiMis<im^sfi i 2A^c,f^fffl1s« 

^-cr^ hag2 oi=«LriB<i-rs. 
[0 0 3 4] w*t6a)«-^®r=j:y, *fiK(4, -y— 
o*<R*«-#Fis«$iBmL, -^^-rTvhsa 

mxx, ^?^-fT>hss2o*<. -y— /<»si oi=f* 
T>hss2 04^ <*raigsi:s-^t^-cnsss3o$ 

[0035] cm 1 (osssgo^fis] a 3 14, m 1 (nuts 

@ 3 i3^-ri8is«)a*ii4, -y^-z^sai oi:^7^-rr> 
hsa2ora-e. ^'7-f7>Ksa2 0A^t,-y— /<sa 



I oiz^Lxiiim ■ mpmmmm^^^mmLkt^ 
iz, ^7 ^-rrvh^a 2 0 j!i<8*«--gj&fl>s± $§isfe-r 
-sijic, Bifciaits • #raif«<D-r'<ra>i««*. -y— 
«ai 0A^&^7^^'7>^sa2 0l=iBfBu *fc, ft 
mmmmmflfnz■^)—/mm.^ oA^e,^7^-^'7'>hsa 

[0036] -J^-f TV hSS2 Oa>fft« ■ ^PltSE 

-<iM*ai<i^e2-o-4i>t,,--y— /\*sa i o (c« ltba 
~mtit. ^-tt-etKo^i^^-y— /<sai o<D8ftfi! ■ w 
1 3A<»<i-r« (s 1 o 1 , s 1 o 2) . -y— 

Sai OI4Bife«i-«^«®lB<iS*<l^*g<i-r-i.i:. 

i&it«E<i*ai o4A^&^7^-^'T>^■sa2ol=i^^i 
r« (SI o3) . -t-OTfip, Ee-r«fi*« • «?sif«i= 

I I 4A>e,-^^-('7'>hsa2oi-E{i-r-5 (si o 

4) . 

[0 0 3 7] <7^-(7>i'mm.2 0Xlt, • 

o 5 t#iBMtase^S2 1 5 tvstmL. mm ■ 

OS*$i8S&-r« (SI 0 5) o t~tzL. <P^'<r>h 

mm 2 o(4®*LfcB*« • wFita*fci4#fffi««A<E 
<l**vc::jEEA^ofcS^i-i4, -y— A^ai oi=«Lr 

^?sis«iBiis«2ni¥-e2 0 4, #rait«ismii*a 
m^S2i 436^&H6^iL, us, -y— /<sai oicstu 

Tiftft - «^1tffi$t=(4#lll19«a>i313£9^-r«. 

[0 0 3 81 -y— /<^ai OI4, 
#ra«aiE<i^si 1 4A^&^?^'f7'>nsa2oi=E 
«-r«. ■i7^'rr>hsa2o«>f*(fflw«wai^S2 1 
314, •f*RHfffis«¥a2 1 5-C'#fiiisffl*a«-r*fc 

if«[A^S'S«t#i-t4. %mt^nmmmmtzizsm 
Ltznmism\zm^istxi (si oe) . 
[0 0 3 9] D.—>fttn±vtm-9^ivimL. 9\-nm 
a 3 o mi&m^mm-r^t #i-i4, nspsia 3 o oism 
o>mmm=ti^i4m^mmf^^m2 ^ 1^^t,^>7-fT>^ 
sa2oi=AA-r^ (s 1 0 7) . ^9sa3o<o«sg 
ofijffis«AtAA$;h.«^. ?i^nffii^a2 0 3i4efcift 

Wfss^fiatttii#a2 o 6i=s-r (s i o 8, s i o 
9) . mmzamnmsm^&z ^ 3(=t.w£{?ih&a 

[0 0 4 0] ?|^^jt«tB1Sll$SltS{^^, ftfii^s 



a) 
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nti'^o) (SI 1 O) . 

(0041] *i-s»itfflei!j^fe«^*t9is-r5i:, nmmm 

$iS3o$£iii-r-&. 
— [0 0 4 2] mx.\i. mAizm-r^ot3:nmmmim\z 

tit, ll£BSi6A>&<0|£iS^m-ettift-$P<0«8V$}- 

^B^rSJi^, g®^rai<L t (d<Lt<Ll) i: 
■^■^i:, Locationa>#£fi|SA^&fl£LT, informatio 

n[o]4(f i *«wssi='S«. com, tf***t-aj»e3 

oi: L-cwww:?^'t7if$g«Lri^fcJi^(-(*, ww 

W::?7'l7ifl4#Kitiffl(7)infonnation[0]4 O 1 l-SA^^t 

Tt^4 rBrowser[0]=http://www. J ©/^^jt 

—9\Zftl\ http://ww. I (PURL $18 < (S 

111). 

[0043] ^8Plt»€Sll^#/><di£-r ^ , #fS1f ft 

iii!&#$s-ro 9\-mmnssMb^n-^sif^i>t, 9\-mm 

mm.3ot&wi-ri> (si i 2) . 
[ o o 4 4 ] tf A<>t-s$ia sonmm $f?jh-r * 

*»-SSSSS8ffil^S2 1 61*. >1.SPgg3 OCD^Tfi 

#$«sai^* (s 1 1 3) . >i-sssES*5ffli^S2 1 6 
li. 9y&mm3O0)mTmmmtii-ritm±mm^wt 
2 0 3(cs*LT, n±nmm^'^mro s±sibs*$ 

S(t« ^ff£«l!a^S2 o 3 », • ^Flf ±«^Btt 
2 0 6 «^ & W^f?il:«tS1f»«$S« L, H^ffih 

<4M*^p,Si$fiia-r-5 (SI 1 4) , 
[0 0 4 5] Jsl±.©<fe5l=. *IIJSfl5J^®-Cli, ^7^^- 

T>hSia2oi4ffifflwi=#BHsa$aii-r-s, 

a2oi*aM**i.fc#raissi$-9— o*^«&s# 

S£ $ MzntAnrnto) miRtmiit tm. 
[0046] im2<r>mm<r>mm'i msit. fS2<r>m^ 

hsaaorai?. ^7^-rr>t-sa2 o*^e,-9— /<sa 

1 OI=^L-CB!fe«-W?sitffiEmil*$SHiLfci:# 

-9— /<sai oil^&E^lr*8ft«i9«•f=fH^ta^ 
❖ 7 T > hse 2 o 4<sm-«-« t rafti=tt« • mfsoi 
m^imnk-ti^-^iz^i^x, nrnm^imm-nti 

[CO 4 71 ^7 ^-fTV^Sa 2 0<»fBfc«-§?5««E 

<i^«aie^e2 o4A^e>, -9— /^ssi oizstLrsfe 
m ' m^^m^ms^m^tntskfsmmms*m^i& 



suts^i^ai 1 3A«s<ir4 (S2 o 1 , s2o 
2) . n—/<&m^ oatAm ■ 'Sfimmvimsiinm^i 

fitsiB^i^ei 0 4A>6^7 5-fT>hsa2 0i=«aM 
i=s<3-r-& (S2 0 3) . -t®^, mmT^mk-mp 

1 4A^t,^^-f7>higa2 0lz»IS!MI=E<i^« (S 

-204).--- 

[GO 4 8] ^^^-f ri/ hSSa2 01*, 

twam^i: i^H'eittst^ • ^?ais«sm#e2 o 5 
ttimmnslm^st2^ sx-sm-tht, &mtmmz 
i«fii-'«F<»s**BBtt-r« (S2 0 5) . fcf£L, a 

m^nmL, mmom9i:i>m»>p>tii>ni-^izii, 
r>hsa2oi4-9— /<sai oic«Lra5feLfcS« 

iz-si^xtm-M^mmmmmntmm^SLzo^. #a 
if#Ems^siis#S2 1 4A^&slm-r'&. 

[0 0 4 9] $f=, S«$nf=lft« ■ «^19ffi^#IS»« 

mtmmm^tii^mi. ■ "sw^m^-nmzff 

■ -^^its. nt&mmcD^miz. 3i» 
[o o 5 0] zL—*fitm±tii» • «^*«BL*i.»^a 

3 oa)eg|*fiJffl-r-5i:#l=l*, *t-SPSS3 Ofl>etg<0 

«^s«$(*aif 21 lA^fe^^-rTvhg 

a2o(zAA-r« (S2 0 6) . nssa 3 o <oiitg(D 

#iJffl5«*«A***i«t, if^«»B*S2 0 3l4, 

is^^ummmmm^mz ^ sizm^ (s 2 o 7, s 2 

08) . 

[005 1] w±^^^nisnmi>t. am^nmm 

#S 2 1 3 /<Sa 1 O & U fc«RilitS$# 

mL, n&n9fsmtm^i,^ti-^i>=itx. 9y&mm 

fi!ftSfefr*3fcS-r-5 (S2 0 9) . 

[00 5 2] m4iz^-rnminmmiztit. n^m 
^. eiaftra3b*L t (o<Lt<Li) t-nt. info 

rroat i on [0] 4 O 1 A^^a I- * . C <0 ^, i— if At^S? 

sia3 o t LTwww^^'^^-tf $a«Lr 

14, >AOVW:?^'?-tfl4#lfflfll«©infonnation[0] 4 O 1 

I^SA^tvTt^'S rBrowser[0]=http://www. j 

<0y<7>— ^l=ttt\ http://wni. 1 1 1 1 1 1 1 1 ig)U R L $ 
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m< (s 2 1 0) , 

[0 0 5 3] *i.ssif«Eiiiife<«^A«*s-r*i:, nmmm 
m^^SL2 1 3ttM-Si5gswffli¥S2 1 ejcnasifse 

SS3 o$en-r« (s2 1 d . 

[o o 5 4] i— tfi^nfflSaa o(7)«ffl*f9jh-r« 
t. 9\■&^mmm^^2^ eit. ^gpsaaoroJSTM 
^*«aiL. *1.aSS3 0A<«TLfcwi:*J6g-r4 

— (-S-2-1-2)-. 

[0 0 5 5] 61±<DJ:5I=, *S!S©»SS-C(*, ^7v-< 

r>hSg2oi*«siwiz<^fraig«=&g<i-r-5, 

a2 0(*«l=IEM**tfc#ISi««*-9— y^Siai OAN& 
S#L, -^^-rT^h^aaoicfci+stt^-WJSros 

[0056] im3 0imm<f)i&m melt, msoi^vi 

a 6 icat-rffisoDsstiii, -9— /^^ai o i:^?^-f T> 
hsaaora-c, ^^-fr>hsa2oi^f,-9— /<sa 

1 0(=»LTIft«l-#^1ffffiiB€93K$il@L^=^# 

(=, -J? ^-frvhsa 2 0 §i5<os*$gi*fe-r 

41fH=-9— /<i^a lOA^&^^-fT^ hsa 2 O t=tt« 
/«Sai OlcJ^LTiBfiS^^amL, ^'^-f 

TV hsa2 oicE<i-r-6^a^(=fct^T#ffii«a$fijffl 

[0 0 5 7] ^7V'rr>hga2 0<DR*«!-§^1tffllB 
<iS*2Ht^e2 0 4AMb, -y— /<Sai OICJ^LTB* 

ft • «?s«aEe5i*a#*3Htr « 4: , -9— /<sa 1 

0<DBfe« • ^?S1tSE<i^SiS<l¥S 1 O 3 *<8*« • m 

is«amms*<i#*s<it- « cs 3 o 1 ) . -y— y«g 
ai o»iftfi-$)Sffl[flE£es«iB#$S€-r«^. s 

^gl 0 44^6^»^-<T>hSa2 0l=E®-r« (S3 

02) , 

[0058] ±iftft • mfsmm^tst» • «^it«s@¥ 
e2 0 5-es<i-rsi:, ■:'^-fT>hsa2oi*Rfc«- 
n^mn&iss^n (S303). tzt£L. ^^^7 

> hSa2 oaS«Lf=8!feft • «FiimA^ii$4irc 

'SA^^fcS^i-tt, -9— /<sai oicsturefes • 

its, #raiSS<DS5IS«$**t^*itt«! • #^fli«E 

{is^sim#S2 o 4, ftfEiit#£es^isi€^S2 1 
[0 0 5 9] ^-Hfi^s^efefin ■ #^${iSL. 

a3 0 0>«^$?4^-r«^$l=l*. 9f9SS3O(0«SS 

s^S2oi=AA-r-& (S3 0 4) . nsssasoioa^ 



rofiJffl^**<A***i€)t. Ii**(lffli¥^e2 o 3(i, n 

B*l£- W?sS^fiait«^f*fffi1S«tfl»^S2 1 3(zS 
-^(830 5, S3 06} . 
[0 0 6 0] S±feait«*Sl+«t-5i:, ■WKHtSfftiJffli 
#®2 1 314. -9— /<Sai OI=»LT, Bt« ■ 

#(Eifi!«E<iM*3m^S2 1 4*^e,EHit-« (S3 o 
7) , Kfe«-^^s^eaif«i:#raif«E<is*^# 
-Bi«ae<ifi«g<i^ai 1 a-c-sitsi-si:. -9— /<s 
a 1 o K-mm. ■ s??#5±ttaflia* * 1 1=. 5 -< t > 
hsa2oi=EM-r'<##BHt«^«iSL, #raitffi$ 

#(ffi19«Em¥ST 1 4*^€)Em■r« (S3 0 8) . fc 
"y=L. ^7^-fT>h»a2 0ttS«Lfcf*IB«a*«S^ 
^tL■CCJ^{:3!l^r5fcli•&rzl*, -9— /<^ai 0(::StLT# 
lliE1t«<OW»IS3)t$#ISIi1tftEmil:4%M€¥-e^2 1 4«^ 
631^ L, SJS. -9— /<Sai OI=*tLrf*BS«««>E 

[0 06 1] #[ffiit«a<i^S2 1 s-e#raifa*s<t 

(8309) . n9saenft#A«9%£-r « ^ nwstm. 
vm^®.2. 1 3tt>i.SBga*9ffli#R2 1 6l=*^spms^ 

saao^esi-r*, 

[0 0 6 2] B4(-*-r#lffi1fffi*«l::i:€>i:, S^ii 

^, SiaftlHI**Lt (0<Lt<L1) i:-r«4:, info 
nnation[0]4 O 1 C<0^, i— 9**^^8? 
sat L•CWWW:7v'l7■9'«a«L■Cl^fcS#(=l*, W 
WW^7';7-9'l*fiHtt1*aiOinfoniiation[0] 4 0 1 
*fCt^S rBrowser[0]=http: //www. ********* J <Dy<^ 
X— ^ htt0://www. (BUR L *§8 < 

(8310) . 

[0 0 6 3] ns9its£ia&#«<di£-r'&t. nwsim. 
«)ffli¥S2 1 3tt*t.gjsa«ffli¥R2 1 6icnss«as 

saao^ea-r* (S3 1 i ) , 

[0 0 6 4] i— 9'*tJ1.»Sa3 0(D*IfflSffih-r* 

t. ns$ia«»^a2 1 614, ^»£a3O(0«7@ 
^$«itiiu, nssaaoAtjSTLfcct^tts-r^ 

(83 12), 

[0 0 6 51 lil±<OJ:ai=, *SIJ6(D3KffiT?l4, 

7> hsa2 ol4^I^Ir=«lafl^«^^g»LJSL^A^ ^- 

V -f T > hSa 2 O l4«lttfll«l=SM*»^ Cfc«$»C. 

■9— '^sai oa>^oSS$*tfc#ifflflia$s^L. ^ 
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[00 6 6] zmAOimmoiT&m ^^mm^ 

hSM2oiyn?. ^7'rT>F-si§2oAx&-9— 
i=, -y— /<«ai o*A&Em-r«8ft«it«*s<i-r«i: 

^^l='j7 7-fT>hSS2 OttWSi- W^(DI¥£fe*BBSfe 
L, #BI1tffl(*-:'^-r7'> hSS2 OAt|*« • -gl^ajs 
Mte-rSltFl-i&llftIf a-r'<-C *--9---=/.<S^g 1 O 

ISSS-y— OA<->^-f TV hSg2 0(Z>!ttT 

[0 0 6 7] ^»^'fT>hSfi2 0«DttlS-#?Sfl|«E 

<ig«KHi^S2 0 4A^&. -y— OI-JtLTS* 

itm-t « t , -f-ti-f *i-y-/ ^sa i o <ott«i • w^wa 

S^S^SM^S 1 O 3 ^#iffi1tffiBBmS3|(S{i#a 1 

1 3 A<Sfi-r « (S401, S402)„ -y— /<Sa 1 

:h.f=Rftft ■ m^mm^. etis • #isflia£€^si o 4 

A*e,/77-f7'>i»sa2o(ciB«-r'S, -t©^. e^g-r 
^KfciS! • $^i9ai=#iiar'&#((iitaa}^i«st. mm 
i=f*ia««Eii#ai 1 4 *>& ^> ^ -fT>h*a 2 of= 

E<i-r-5 (S4 0 3. S404), 
[0 0 6 81 • #|i«a$5ft« • §PmaS<i#® 

2 0 5-eSm-r^i:, ^'^-f7'>hga2 0l±tt{6- 

p<»m±imib-ri (S4 0 5) . fc/fu, ise*vh 

82 0 tt-y- /<sia 1 o iza lts* Lfc««o!)S3is 
■-itF1f«£mS«£4t#S2 0 4. #Rii8asms3« 

sie^S2 1 4A^&2i€-r<&. 
[o o 6 9] *fc. e<i**ifcB*«! • "s^mmtnmm 

■ M^oiw^izxiL-DXff^, mjiit. ■msonsis* 
(offls, ttft-^Fifta. ntAftmommmz. 3»a>m 

[0 0 7 0] -y^-y^siai oii. ftnitssa^ai i 

¥®i 1 2-e8iai-r«t. <?^-(7>h&s.2oizs^ 



# Ltznmmmtmtzizsm Ltzi^mmmiimtsiit^ 
(ztt. ^n-rmmismimtzizsimLtznmmmzm 

^^?Li> (S4 O 6) . 

[o o 7 1 ] i— yiiw^B^ia • wi^^ffiBL^i-asa 
nistmimm^it^iztt. fi-n^msooimmmmm 
s**«raifffi^ft¥S2 1 1 *^€.^>5'fT>hS[a2 

0J::A*-r« (S4 o 7) , 

[OO 7 2] >t-aJSS3 Oa)a«8<DfiJffiS*A*A***t 

nmmmum^^2^ aizSLT (.S4 0 8. s4o 

9) . 

[0 0 7 3] w±«taita$s(tai-&<b. #fiiita$<i{ai 
#S2 1 3(*-y— /N-ggT oANe,s^tLfc#rafisa$# 

HL. S^<4a«ai:Sifc.L^*3l*-SC:t-e, *1-S»«« 

@l(iji&ft^$ft;g-r« (S4 1 o) . 
[0 0 7 4] mAizjsi-rnm^m^mizt^t. m±m 

■a, ISja^ia*«L t (0<Lt<Ll) info 
nnation[0]4 0 1 *<^g!l(-)5:S, Z.0>^. n— 1fA<*HP 

Sas 0 1 U-cwwwt^^-l^-ysstRL-cu^fc*^!; 

I*, WWW^7'>1fM:#iaitffi(0infomiation[0]4O 1 

l=S4^*tTL^.6 rBrowser[0]=http://www. mi J 

<D/<^/— $^(C^6t^, http://»ww. 1 1 1 1 1 1 1 1 i<OU R L S 
K< (S4 1 1 ) . 

[0 0 7 5] »-&mm&m&m*3i&-ti>t. nminn 

*gffii¥a2 1 3i*ns»^ssflsi#®2 1 6ic*i-gsisae 

^as osea-r-s (S4 1 2) . 
[0 0 7 6] 3.—- yaJi^^i-SBSias o<o*ijffl$<?jh-r* 
^, ^S9sa»»^S2 1 614, ne9sa3oo}«7m 

^$«iii3L, »l>8PSia3 0A<ie7L^C^$ttS-^« 

(S4 1 3) . 

[0077] lslJt«)J:3l=, *SISS©»!|-CI*, ^^'T 

7>Ksa2ott. namnoiAmmiz^mnxtzmL 

^i:fc«^ri=. ^'^'frv hsa2ott, a[s**Lfc# 
ittfl»«$-y— /<sai oAxfea^u ^^^-fT^hsa 

[00 7 8] ls^ifl>aeg|c^5^^•c, t3k&-m^t 
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[O O 7 9] 10 1 

ti=j:y, ffim^-y h"?— j?±.i?tt«- wis$ie<i-r4 103 

m-Srlz. tjk9i''S^im<DmiS^tzttM±i&mir>^iiLit 104 

Lx, um^nos.mmmii^mtf3:i>o Ltztt^sx. 1 1 1 

8!fe« ■ #raiSS(DSMA*±i:fc«^-e 1 1 2 

#i9i»aa)aEs««*-9— /<SB3b^&^>9■<r> h 1 1 3 

Sai=«LTEm^rtli:'{Eor04. 114 

i^mommtsiMimi 2 o 
isti -^i—f^mmnm&m^^-rsxtb^o — 2-0-1- 

[B2] ^7'f7>h$IB(O«fie0!l$^t-H-ca&«. 202 

[@ 3 ] mi <DlltE«)]i»tlt=^lt««l310!>2iStl$IS^-^ 2 0 3 

^tziba)SXtbi.. 2 0 4 

[B4] ftiiaflm(Offi$^-rB-ej&«. 2 05 

[@ 5 ] m 2 <osgti<D]&ffit=^it'&ffiSc:>3iE4i$SieQ-r 2 o e 

*fctoa)@-cfc«, 2 1 1 

[S6] m3<o§giia>]&®(=j3it-&«iis<o3Sti$stQQt- 2 1 2 

'&fcX>(OB-Cfe«. 2 13 

[@7l m4(0llit<D]gffil=felt-&ffi9(09tE4l$Keq-r 2 1 4 

*fc«)©0-efcS. 2 15 

[^a>R^] 2 1 6 
1 o -tf— 100 
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